[Freeipa-users] Freeipa 4.2.0 hangs intermittently
Rakesh Rajasekharan
rakesh.rajasekharan at gmail.com
Fri Sep 16 10:12:47 UTC 2016
Hi Thierry,
I am not quite sure on the SRCH or ADD operations as the environment was
live and few other guys also are using the command line to search or add
users.
I did not promote it to replica and was running just as a client
Thanks,
Rakesh
On Fri, Sep 16, 2016 at 1:59 PM, thierry bordaz <tbordaz at redhat.com> wrote:
> Hi Rakesh,
>
> Thank you so much for those precious feedback.
> You are right I did test 4.3 while you were testing 4.2. Upgrading is a
> good option but regarding the suspected bug it should not have impact but
> the dynamic of the install is likely quite different.
>
> I do not know from where is coming this flow of Clock skew messages. Is
> ntpd still running ?
>
>
> At the time of the hang, the provided pstacks contained some SRCHs and
> sometime ADD. Do you remember the kind of search/update you did apply when
> the hang occurred ? From server or client ?
> Also after configuring client, did you promote them to replica or just
> keep them as client ?
>
> thanks
> thierry
>
> On 09/15/2016 09:14 PM, Rakesh Rajasekharan wrote:
>
> Hi Thierry,
>
> I had been doing pretty much the same to reproduce the hang..
> After changing the checkpoint interval.. the hangs had become manageable..
>
> However, this time when the hang occurred.. I did not add any clients and
> also the behavior was bit different. This time my ns-slapd did not hang..
> ldapsearch was working fine.. but, the ipa commands were taking a long
> time to respond and most users were not able to login to any of the
> clients..
> restarting ipa did not help either.
>
> I was seeing around 14-15 connections in SYN_RECV state continously and
> /var.log/messages has entries like "TCP: request_sock_TCP: Possible SYN
> flooding on port 88. Sending cookies. Check SNMP counter"
>
> I also see in the /var/log/krb5kdc.log this error
>
> ipa-master-xyz.com krb5kdc[15308](info): TGS_REQ (4 etypes {18 17 16 23})
> 10.1.12.155: PROCESS_TGS: authtime 0, host/10.1.12.155 at XYZ.COM for ldap/
> ipa-master-xyz.com at XYZ.COM, Clock skew too great
>
> there are arounf 7.5k messages like that.. which I guess is too high
> grep "krbtgt/XYZ.COM at XYZ.COM, Clock skew too great" /var/log/krb5kdc.log
> | wc -l
> 7570
>
> Would this give rise to a hang or make IPA nonresponsive..
>
> The kinit admin command itself was taking an unusually long time to
> respond..
>
> KRB5_TRACE=/dev/stderr kinit admin
> [11298] 1473702491.60880: Getting initial credentials for <admin at XYZ.COM>
> admin at XYZ.COM
> [11298] 1473702491.62981: Sending request (167 bytes) to XYZ.COM
> [11298] 1473702491.63119: Initiating TCP connection to stream 10.1.3.35:88
> [11298] 1473702491.63359: Sending TCP request to stream 10.1.3.35:88
> [11298] 1473702493.797835: Received answer (341 bytes) from stream
> 10.1.3.35:88
> [11298] 1473702493.797848: Terminating TCP connection to stream
> 10.1.3.35:88
> [11298] 1473702493.797911: Response was from master KDC
> [11298] 1473702493.797956: Received error from KDC: -1765328359/Additional
> pre-authentication required
> [11298] 1473702493.797993: Processing preauth types: 136, 19, 2, 133
> [11298] 1473702493.798005: Selected etype info: etype aes256-cts, salt
> "V at Cbu147E#1;R0WD", params ""
> [11298] 1473702493.798009: Received cookie: MIT
> Password for admin at XYZ.COM:
> [11298] 1473702498.190064: AS key obtained for encrypted timestamp:
> aes256-cts/2C9D
> [11298] 1473702498.190109: Encrypted timestamp (for 1473702498.184527):
> plain 301AA011180F32303136303931323137343831385AA105020302D0CF, encrypted
> 25FC8D37EFB6B7837C8D5C6649DFB9972010D40EE29D1222FBA45CAA9842
> 8E42C7FCC9B7FE881A04BD3390A6A9EDE9D2D93729FDF3E47B6D
> [11298] 1473702498.190129: Preauth module encrypted_timestamp (2) (real)
> returned: 0/Success
> [11298] 1473702498.190133: Produced preauth for next request: 133, 2
> [11298] 1473702498.190148: Sending request (261 bytes) to XYZ.COM
> [11298] 1473702498.190246: Initiating TCP connection to stream
> 10.1.3.35:88
> [11298] 1473702499.191933: Sending initial UDP request to dgram
> 10.1.3.35:88
> [11298] 1473702502.195157: Sending retry UDP request to dgram 10.1.3.35:88
> [11298] 1473702507.200405: Sending retry UDP request to dgram 10.1.3.35:88
> [11298] 1473702513.226371: Sending TCP request to stream 10.1.3.35:88
> [11298] 1473702515.797243: Received answer (730 bytes) from stream
> 10.1.3.35:88
> [11298] 1473702515.797271: Terminating TCP connection to stream
> 10.1.3.35:88
> [11298] 1473702515.797326: Response was from master KDC
> [11298] 1473702515.797353: Processing preauth types: 19
> [11298] 1473702515.797360: Selected etype info: etype aes256-cts, salt
> "V at Cbu147E#1;R0WD", params ""
> [11298] 1473702515.797394: Produced preauth for next request: (empty)
> [11298] 1473702515.797401: AS key determined by preauth: aes256-cts/2C9D
> [11298] 1473702515.797445: Decrypted AS reply; session key is:
> aes256-cts/702E
> [11298] 1473702515.797460: FAST negotiation: available
> [11298] 1473702515.797478: Initializing KEYRING:persistent:0:0 with
> default princ admin at XYZ.COM
> [11298] 1473702515.797534: Storing admin at XYZ.COM -> krbtgt/
> <XYZ.COM at XYZ.COM>XYZ.COM at XYZ.COM in KEYRING:persistent:0:0
> [11298] 1473702515.797572: Storing config in KEYRING:persistent:0:0 for
> krbtgt/XYZ.COM at XYZ.COM: fast_avail: yes
> [11298] 1473702515.797585: Storing admin at XYZ.COM ->
> krb5_ccache_conf_data/fast_avail/krbtgt\/XYZ.COM\@XYZ.COM at X-CACHECONF: in
> KEYRING:persistent:0:0
> [11298] 1473702515.797631: Storing config in KEYRING:persistent:0:0 for
> krbtgt/XYZ.COM at XYZ.COM: pa_type: 2
> [11298] 1473702515.797647: Storing admin at XYZ.COM ->
> krb5_ccache_conf_data/pa_type/krbtgt\/XYZ.COM\@XYZ.COM at X-CACHECONF: in
> KEYRING:persistent:0:0
>
>
>
> Could it be an version specific issue..as I am running 4.2.0 verison.. and
> yours is 4.3.2
>
> If so, I will try to upgrade my IPA version
>
> Thanks
> Rakesh
>
>
>
>
>
>
> On Thu, Sep 15, 2016 at 10:08 PM, thierry bordaz <tbordaz at redhat.com>
> wrote:
>
>> Hello Rakesh,
>>
>> Sorry to be back so late. I finally manage to try to reproduce locally
>> the hang of DS... and I fail ;-)
>>
>> I am running 4 VM, with freeipa 4.3.2.
>> One is running a server (where I provisioned some users), with 200Mb
>> cache. The server receives no direct load (SRCH or update).
>> The tree others are running in a loop ipa-client-install and uninstall.
>> So far it has run for several hours without hang.
>>
>> Going through the mail thread I have not found others details.
>> Am I missing something to reproduce ?
>>
>> thanks in advance for your help
>> thierry
>>
>> On 09/07/2016 01:46 PM, Rakesh Rajasekharan wrote:
>>
>> I changed the nsslapd-db-checkpoint interval first to 80 and increased
>> till 160.. however the hang has not gone away yet
>>
>>
>> I migrated my data from a openldap, can that cause issues like this.. If
>> so, i could try creating users from scratch directly on IPA rather than
>> migrating and test it
>>
>> But before that , have taken a fresh pstack just incase if it helps to
>> nail down the issue
>>
>> Thread 44 (Thread 0x7f53ed52f700 (LWP 128165)):
>> #0 0x00007f54047649b3 in select () from /lib64/libc.so.6
>> #1 0x00007f5406eef0e9 in DS_Sleep () from /usr/lib64/dirsrv/libslapd.so.
>> 0
>> #2 0x00007f53fa53d907 in deadlock_threadmain () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #3 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
>> #4 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
>> #5 0x00007f540476d28d in clone () from /lib64/libc.so.6
>> Thread 43 (Thread 0x7f53ecd2e700 (LWP 128166)):
>> #0 0x00007f54047649b3 in select () from /lib64/libc.so.6
>> #1 0x00007f53ff0cbbad in __os_yield () from /lib64/libdb-5.3.so
>> #2 0x00007f53ff0c72b3 in __memp_sync_int () from /lib64/libdb-5.3.so
>> #3 0x00007f53ff0d7752 in __txn_checkpoint () from /lib64/libdb-5.3.so
>> #4 0x00007f53ff0d7b74 in __txn_checkpoint_pp () from /lib64/libdb-5.3.so
>> #5 0x00007f53fa541a87 in checkpoint_threadmain () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #6 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
>> #7 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
>> #8 0x00007f540476d28d in clone () from /lib64/libc.so.6
>> Thread 42 (Thread 0x7f53ec52d700 (LWP 128167)):
>> #0 0x00007f54047649b3 in select () from /lib64/libc.so.6
>> #1 0x00007f5406eef0e9 in DS_Sleep () from /usr/lib64/dirsrv/libslapd.so.
>> 0
>> #2 0x00007f53fa53db7f in trickle_threadmain () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #3 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
>> #4 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
>> #5 0x00007f540476d28d in clone () from /lib64/libc.so.6
>> Thread 41 (Thread 0x7f53ebd2c700 (LWP 128168)):
>> #0 0x00007f54047649b3 in select () from /lib64/libc.so.6
>> #1 0x00007f5406eef0e9 in DS_Sleep () from /usr/lib64/dirsrv/libslapd.so.
>> 0
>> #2 0x00007f53fa538707 in perf_threadmain () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #3 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
>> #4 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
>> #5 0x00007f540476d28d in clone () from /lib64/libc.so.6
>> Thread 40 (Thread 0x7f53eb322700 (LWP 128204)):
>> #0 0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
>> /lib64/libpthread.so.0
>> #1 0x00007f5405099050 in PR_WaitCondVar () from /lib64/libnspr4.so
>> #2 0x00007f5406ede198 in slapi_wait_condvar () from
>> /usr/lib64/dirsrv/libslapd.so.0
>> #3 0x00007f53fd27062e in cos_cache_wait_on_change () from
>> /usr/lib64/dirsrv/plugins/libcos-plugin.so
>> #4 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
>> #5 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
>> #6 0x00007f540476d28d in clone () from /lib64/libc.so.6
>> Thread 39 (Thread 0x7f53eab21700 (LWP 128206)):
>> #0 0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
>> /lib64/libpthread.so.0
>> #1 0x00007f5405099050 in PR_WaitCondVar () from /lib64/libnspr4.so
>> #2 0x00007f5406ede198 in slapi_wait_condvar () from
>> /usr/lib64/dirsrv/libslapd.so.0
>> #3 0x00007f53f8bdbeed in roles_cache_wait_on_change () from
>> /usr/lib64/dirsrv/plugins/libroles-plugin.so
>> #4 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
>> #5 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
>> #6 0x00007f540476d28d in clone () from /lib64/libc.so.6
>> Thread 38 (Thread 0x7f53ea320700 (LWP 128207)):
>> #0 0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
>> /lib64/libpthread.so.0
>> #1 0x00007f5405099050 in PR_WaitCondVar () from /lib64/libnspr4.so
>> #2 0x00007f5406ede198 in slapi_wait_condvar () from
>> /usr/lib64/dirsrv/libslapd.so.0
>> #3 0x00007f53f8bdbeed in roles_cache_wait_on_change () from
>> /usr/lib64/dirsrv/plugins/libroles-plugin.so
>> #4 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
>> #5 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
>> #6 0x00007f540476d28d in clone () from /lib64/libc.so.6
>> Thread 37 (Thread 0x7f53e9b1f700 (LWP 128208)):
>> #0 0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
>> /lib64/libpthread.so.0
>> #1 0x00007f5405099050 in PR_WaitCondVar () from /lib64/libnspr4.so
>> #2 0x00007f5406ede198 in slapi_wait_condvar () from
>> /usr/lib64/dirsrv/libslapd.so.0
>> #3 0x00007f53f8bdbeed in roles_cache_wait_on_change () from
>> /usr/lib64/dirsrv/plugins/libroles-plugin.so
>> #4 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
>> #5 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
>> #6 0x00007f540476d28d in clone () from /lib64/libc.so.6
>> Thread 36 (Thread 0x7f53e931e700 (LWP 128209)):
>> #0 0x00007f5404a43a82 in pthread_cond_timedwait@@GLIBC_2.3.2 () from
>> /lib64/libpthread.so.0
>> #1 0x00007f5405098b07 in pt_TimedWait () from /lib64/libnspr4.so
>> #2 0x00007f5405098fce in PR_WaitCondVar () from /lib64/libnspr4.so
>> #3 0x00007f5407397d03 in housecleaning ()
>> #4 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
>> #5 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
>> #6 0x00007f540476d28d in clone () from /lib64/libc.so.6
>> Thread 35 (Thread 0x7f53e8b1d700 (LWP 128210)):
>> #0 0x00007f5404a43a82 in pthread_cond_timedwait@@GLIBC_2.3.2 () from
>> /lib64/libpthread.so.0
>> #1 0x00007f5405098b07 in pt_TimedWait () from /lib64/libnspr4.so
>> #2 0x00007f5405098fce in PR_WaitCondVar () from /lib64/libnspr4.so
>> #3 0x00007f5406e841e8 in eq_loop () from /usr/lib64/dirsrv/libslapd.so.0
>> #4 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
>> #5 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
>> #6 0x00007f540476d28d in clone () from /lib64/libc.so.6
>> Thread 34 (Thread 0x7f53db7fe700 (LWP 128212)):
>> #0 0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
>> /lib64/libpthread.so.0
>> #1 0x00007f53fef9f2f3 in __db_hybrid_mutex_suspend () from /lib64/
>> libdb-5.3.so
>> #2 0x00007f53fef9e640 in __db_tas_mutex_lock () from /lib64/libdb-5.3.so
>> #3 0x00007f53ff048d3a in __lock_get_internal () from /lib64/libdb-5.3.so
>> #4 0x00007f53ff049820 in __lock_get () from /lib64/libdb-5.3.so
>> #5 0x00007f53ff075142 in __db_lget () from /lib64/libdb-5.3.so
>> #6 0x00007f53fefbc605 in __bam_search () from /lib64/libdb-5.3.so
>> #7 0x00007f53fefa7256 in __bamc_search () from /lib64/libdb-5.3.so
>> #8 0x00007f53fefa8d0f in __bamc_get () from /lib64/libdb-5.3.so
>> #9 0x00007f53ff061ca6 in __dbc_iget () from /lib64/libdb-5.3.so
>> #10 0x00007f53ff070b02 in __dbc_get_pp () from /lib64/libdb-5.3.so
>> #11 0x00007f53fa54c680 in idl_new_fetch () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #12 0x00007f53fa55ab26 in index_read_ext_allids () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #13 0x00007f53fa545284 in keys2idl () from /usr/lib64/dirsrv/plugins/libb
>> ack-ldbm.so
>> #14 0x00007f53fa5459e3 in ava_candidates.isra.0 () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #15 0x00007f53fa545fd2 in filter_candidates_ext () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #16 0x00007f53fa547096 in list_candidates () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #17 0x00007f53fa545f40 in filter_candidates_ext () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #18 0x00007f53fa58180c in subtree_candidates () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #19 0x00007f53fa582e7f in ldbm_back_search () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #20 0x00007f5406eb01d6 in op_shared_search () from
>> /usr/lib64/dirsrv/libslapd.so.0
>> #21 0x00007f54073a133e in do_search ()
>> #22 0x00007f540738f567 in connection_threadmain ()
>> #23 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
>> #24 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
>> #25 0x00007f540476d28d in clone () from /lib64/libc.so.6
>> Thread 33 (Thread 0x7f53daffd700 (LWP 128213)):
>> #0 0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
>> /lib64/libpthread.so.0
>> #1 0x00007f53fef9f2f3 in __db_hybrid_mutex_suspend () from /lib64/
>> libdb-5.3.so
>> #2 0x00007f53fef9e640 in __db_tas_mutex_lock () from /lib64/libdb-5.3.so
>> #3 0x00007f53ff048d3a in __lock_get_internal () from /lib64/libdb-5.3.so
>> #4 0x00007f53ff049820 in __lock_get () from /lib64/libdb-5.3.so
>> #5 0x00007f53ff075142 in __db_lget () from /lib64/libdb-5.3.so
>> #6 0x00007f53fefbc605 in __bam_search () from /lib64/libdb-5.3.so
>> #7 0x00007f53fefa7256 in __bamc_search () from /lib64/libdb-5.3.so
>> #8 0x00007f53fefa8d0f in __bamc_get () from /lib64/libdb-5.3.so
>> #9 0x00007f53ff061ca6 in __dbc_iget () from /lib64/libdb-5.3.so
>> #10 0x00007f53ff070b02 in __dbc_get_pp () from /lib64/libdb-5.3.so
>> #11 0x00007f53fa54c680 in idl_new_fetch () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #12 0x00007f53fa55ab26 in index_read_ext_allids () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #13 0x00007f53fa545284 in keys2idl () from /usr/lib64/dirsrv/plugins/libb
>> ack-ldbm.so
>> #14 0x00007f53fa5459e3 in ava_candidates.isra.0 () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #15 0x00007f53fa545fd2 in filter_candidates_ext () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #16 0x00007f53fa547096 in list_candidates () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #17 0x00007f53fa545f40 in filter_candidates_ext () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #18 0x00007f53fa58180c in subtree_candidates () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #19 0x00007f53fa582e7f in ldbm_back_search () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #20 0x00007f5406eb01d6 in op_shared_search () from
>> /usr/lib64/dirsrv/libslapd.so.0
>> #21 0x00007f54073a133e in do_search ()
>> #22 0x00007f540738f567 in connection_threadmain ()
>> #23 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
>> #24 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
>> #25 0x00007f540476d28d in clone () from /lib64/libc.so.6
>> Thread 32 (Thread 0x7f53da7fc700 (LWP 128214)):
>> #0 0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
>> /lib64/libpthread.so.0
>> #1 0x00007f53fef9f2f3 in __db_hybrid_mutex_suspend () from /lib64/
>> libdb-5.3.so
>> #2 0x00007f53fef9e640 in __db_tas_mutex_lock () from /lib64/libdb-5.3.so
>> #3 0x00007f53ff048d3a in __lock_get_internal () from /lib64/libdb-5.3.so
>> #4 0x00007f53ff049820 in __lock_get () from /lib64/libdb-5.3.so
>> #5 0x00007f53ff075142 in __db_lget () from /lib64/libdb-5.3.so
>> #6 0x00007f53fefbc605 in __bam_search () from /lib64/libdb-5.3.so
>> #7 0x00007f53fefa7256 in __bamc_search () from /lib64/libdb-5.3.so
>> #8 0x00007f53fefa8d0f in __bamc_get () from /lib64/libdb-5.3.so
>> #9 0x00007f53ff061ca6 in __dbc_iget () from /lib64/libdb-5.3.so
>> #10 0x00007f53ff070b02 in __dbc_get_pp () from /lib64/libdb-5.3.so
>> #11 0x00007f53fa54c680 in idl_new_fetch () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #12 0x00007f53fa55ab26 in index_read_ext_allids () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #13 0x00007f53fa545284 in keys2idl () from /usr/lib64/dirsrv/plugins/libb
>> ack-ldbm.so
>> #14 0x00007f53fa5459e3 in ava_candidates.isra.0 () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #15 0x00007f53fa545fd2 in filter_candidates_ext () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #16 0x00007f53fa547096 in list_candidates () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #17 0x00007f53fa545f40 in filter_candidates_ext () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #18 0x00007f53fa547096 in list_candidates () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #19 0x00007f53fa545f40 in filter_candidates_ext () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #20 0x00007f53fa547096 in list_candidates () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #21 0x00007f53fa545f40 in filter_candidates_ext () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #22 0x00007f53fa58180c in subtree_candidates () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #23 0x00007f53fa582e7f in ldbm_back_search () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #24 0x00007f5406eb01d6 in op_shared_search () from
>> /usr/lib64/dirsrv/libslapd.so.0
>> #25 0x00007f54073a133e in do_search ()
>> #26 0x00007f540738f3c3 in connection_threadmain ()
>> #27 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
>> #28 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
>> #29 0x00007f540476d28d in clone () from /lib64/libc.so.6
>> Thread 31 (Thread 0x7f53d9ffb700 (LWP 128215)):
>> #0 0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
>> /lib64/libpthread.so.0
>> #1 0x00007f53fef9f2f3 in __db_hybrid_mutex_suspend () from /lib64/
>> libdb-5.3.so
>> #2 0x00007f53fef9e640 in __db_tas_mutex_lock () from /lib64/libdb-5.3.so
>> #3 0x00007f53ff048d3a in __lock_get_internal () from /lib64/libdb-5.3.so
>> #4 0x00007f53ff049820 in __lock_get () from /lib64/libdb-5.3.so
>> #5 0x00007f53ff075142 in __db_lget () from /lib64/libdb-5.3.so
>> #6 0x00007f53fefbc605 in __bam_search () from /lib64/libdb-5.3.so
>> #7 0x00007f53fefa7256 in __bamc_search () from /lib64/libdb-5.3.so
>> #8 0x00007f53fefa8d0f in __bamc_get () from /lib64/libdb-5.3.so
>> #9 0x00007f53ff061ca6 in __dbc_iget () from /lib64/libdb-5.3.so
>> #10 0x00007f53ff070b02 in __dbc_get_pp () from /lib64/libdb-5.3.so
>> #11 0x00007f53fa54c680 in idl_new_fetch () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #12 0x00007f53fa55ab26 in index_read_ext_allids () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #13 0x00007f53fa545284 in keys2idl () from /usr/lib64/dirsrv/plugins/libb
>> ack-ldbm.so
>> #14 0x00007f53fa5459e3 in ava_candidates.isra.0 () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #15 0x00007f53fa545fd2 in filter_candidates_ext () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #16 0x00007f53fa547096 in list_candidates () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #17 0x00007f53fa545f40 in filter_candidates_ext () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #18 0x00007f53fa58180c in subtree_candidates () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #19 0x00007f53fa582e7f in ldbm_back_search () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #20 0x00007f5406eb01d6 in op_shared_search () from
>> /usr/lib64/dirsrv/libslapd.so.0
>> #21 0x00007f54073a133e in do_search ()
>> #22 0x00007f540738f567 in connection_threadmain ()
>> #23 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
>> #24 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
>> #25 0x00007f540476d28d in clone () from /lib64/libc.so.6
>> Thread 30 (Thread 0x7f53d97fa700 (LWP 128216)):
>> #0 0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
>> /lib64/libpthread.so.0
>> #1 0x00007f53fef9f2f3 in __db_hybrid_mutex_suspend () from /lib64/
>> libdb-5.3.so
>> #2 0x00007f53fef9e640 in __db_tas_mutex_lock () from /lib64/libdb-5.3.so
>> #3 0x00007f53ff048d3a in __lock_get_internal () from /lib64/libdb-5.3.so
>> #4 0x00007f53ff049820 in __lock_get () from /lib64/libdb-5.3.so
>> #5 0x00007f53ff075142 in __db_lget () from /lib64/libdb-5.3.so
>> #6 0x00007f53fefbc605 in __bam_search () from /lib64/libdb-5.3.so
>> #7 0x00007f53fefa7256 in __bamc_search () from /lib64/libdb-5.3.so
>> #8 0x00007f53fefa8d0f in __bamc_get () from /lib64/libdb-5.3.so
>> #9 0x00007f53ff061ca6 in __dbc_iget () from /lib64/libdb-5.3.so
>> #10 0x00007f53ff070b02 in __dbc_get_pp () from /lib64/libdb-5.3.so
>> #11 0x00007f53fa54c680 in idl_new_fetch () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #12 0x00007f53fa55ab26 in index_read_ext_allids () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #13 0x00007f53fa545284 in keys2idl () from /usr/lib64/dirsrv/plugins/libb
>> ack-ldbm.so
>> #14 0x00007f53fa5459e3 in ava_candidates.isra.0 () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #15 0x00007f53fa545fd2 in filter_candidates_ext () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #16 0x00007f53fa547096 in list_candidates () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #17 0x00007f53fa545f40 in filter_candidates_ext () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #18 0x00007f53fa58180c in subtree_candidates () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #19 0x00007f53fa582e7f in ldbm_back_search () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #20 0x00007f5406eb01d6 in op_shared_search () from
>> /usr/lib64/dirsrv/libslapd.so.0
>> #21 0x00007f54073a133e in do_search ()
>> #22 0x00007f540738f567 in connection_threadmain ()
>> #23 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
>> #24 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
>> #25 0x00007f540476d28d in clone () from /lib64/libc.so.6
>> Thread 29 (Thread 0x7f53d8ff9700 (LWP 128217)):
>> #0 0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
>> /lib64/libpthread.so.0
>> #1 0x00007f53fef9f2f3 in __db_hybrid_mutex_suspend () from /lib64/
>> libdb-5.3.so
>> #2 0x00007f53fef9e640 in __db_tas_mutex_lock () from /lib64/libdb-5.3.so
>> #3 0x00007f53ff048d3a in __lock_get_internal () from /lib64/libdb-5.3.so
>> #4 0x00007f53ff049820 in __lock_get () from /lib64/libdb-5.3.so
>> #5 0x00007f53ff075142 in __db_lget () from /lib64/libdb-5.3.so
>> #6 0x00007f53fefbc605 in __bam_search () from /lib64/libdb-5.3.so
>> #7 0x00007f53fefa7256 in __bamc_search () from /lib64/libdb-5.3.so
>> #8 0x00007f53fefa8d0f in __bamc_get () from /lib64/libdb-5.3.so
>> #9 0x00007f53ff061ca6 in __dbc_iget () from /lib64/libdb-5.3.so
>> #10 0x00007f53ff070b02 in __dbc_get_pp () from /lib64/libdb-5.3.so
>> #11 0x00007f53fa54c680 in idl_new_fetch () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #12 0x00007f53fa55ab26 in index_read_ext_allids () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #13 0x00007f53fa545284 in keys2idl () from /usr/lib64/dirsrv/plugins/libb
>> ack-ldbm.so
>> #14 0x00007f53fa5459e3 in ava_candidates.isra.0 () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #15 0x00007f53fa545fd2 in filter_candidates_ext () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #16 0x00007f53fa547096 in list_candidates () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #17 0x00007f53fa545f40 in filter_candidates_ext () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #18 0x00007f53fa58180c in subtree_candidates () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #19 0x00007f53fa582e7f in ldbm_back_search () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #20 0x00007f5406eb01d6 in op_shared_search () from
>> /usr/lib64/dirsrv/libslapd.so.0
>> #21 0x00007f54073a133e in do_search ()
>> #22 0x00007f540738f567 in connection_threadmain ()
>> #23 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
>> #24 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
>> #25 0x00007f540476d28d in clone () from /lib64/libc.so.6
>> Thread 28 (Thread 0x7f53d87f8700 (LWP 128218)):
>> #0 0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
>> /lib64/libpthread.so.0
>> #1 0x00007f53fef9f2f3 in __db_hybrid_mutex_suspend () from /lib64/
>> libdb-5.3.so
>> #2 0x00007f53fef9e640 in __db_tas_mutex_lock () from /lib64/libdb-5.3.so
>> #3 0x00007f53ff048d3a in __lock_get_internal () from /lib64/libdb-5.3.so
>> #4 0x00007f53ff049820 in __lock_get () from /lib64/libdb-5.3.so
>> #5 0x00007f53ff075142 in __db_lget () from /lib64/libdb-5.3.so
>> #6 0x00007f53fefbc605 in __bam_search () from /lib64/libdb-5.3.so
>> #7 0x00007f53fefa7256 in __bamc_search () from /lib64/libdb-5.3.so
>> #8 0x00007f53fefa8d0f in __bamc_get () from /lib64/libdb-5.3.so
>> #9 0x00007f53ff061ca6 in __dbc_iget () from /lib64/libdb-5.3.so
>> #10 0x00007f53ff070b02 in __dbc_get_pp () from /lib64/libdb-5.3.so
>> #11 0x00007f53fa54c680 in idl_new_fetch () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #12 0x00007f53fa55ab26 in index_read_ext_allids () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #13 0x00007f53fa545284 in keys2idl () from /usr/lib64/dirsrv/plugins/libb
>> ack-ldbm.so
>> #14 0x00007f53fa5459e3 in ava_candidates.isra.0 () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #15 0x00007f53fa545fd2 in filter_candidates_ext () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #16 0x00007f53fa547096 in list_candidates () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #17 0x00007f53fa545f40 in filter_candidates_ext () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #18 0x00007f53fa58180c in subtree_candidates () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #19 0x00007f53fa582e7f in ldbm_back_search () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #20 0x00007f5406eb01d6 in op_shared_search () from
>> /usr/lib64/dirsrv/libslapd.so.0
>> #21 0x00007f54073a133e in do_search ()
>> #22 0x00007f540738f567 in connection_threadmain ()
>> #23 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
>> #24 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
>> #25 0x00007f540476d28d in clone () from /lib64/libc.so.6
>> Thread 27 (Thread 0x7f53d7ff7700 (LWP 128219)):
>> #0 0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
>> /lib64/libpthread.so.0
>> #1 0x00007f53fef9f2f3 in __db_hybrid_mutex_suspend () from /lib64/
>> libdb-5.3.so
>> #2 0x00007f53fef9e640 in __db_tas_mutex_lock () from /lib64/libdb-5.3.so
>> #3 0x00007f53ff048d3a in __lock_get_internal () from /lib64/libdb-5.3.so
>> #4 0x00007f53ff049820 in __lock_get () from /lib64/libdb-5.3.so
>> #5 0x00007f53ff075142 in __db_lget () from /lib64/libdb-5.3.so
>> #6 0x00007f53fefbc605 in __bam_search () from /lib64/libdb-5.3.so
>> #7 0x00007f53fefa7256 in __bamc_search () from /lib64/libdb-5.3.so
>> #8 0x00007f53fefa8d0f in __bamc_get () from /lib64/libdb-5.3.so
>> #9 0x00007f53ff061ca6 in __dbc_iget () from /lib64/libdb-5.3.so
>> #10 0x00007f53ff070b02 in __dbc_get_pp () from /lib64/libdb-5.3.so
>> #11 0x00007f53fa54c680 in idl_new_fetch () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #12 0x00007f53fa55ab26 in index_read_ext_allids () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #13 0x00007f53fa545284 in keys2idl () from /usr/lib64/dirsrv/plugins/libb
>> ack-ldbm.so
>> #14 0x00007f53fa5459e3 in ava_candidates.isra.0 () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #15 0x00007f53fa545fd2 in filter_candidates_ext () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #16 0x00007f53fa547096 in list_candidates () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #17 0x00007f53fa545f40 in filter_candidates_ext () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #18 0x00007f53fa58180c in subtree_candidates () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #19 0x00007f53fa582e7f in ldbm_back_search () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #20 0x00007f5406eb01d6 in op_shared_search () from
>> /usr/lib64/dirsrv/libslapd.so.0
>> #21 0x00007f54073a133e in do_search ()
>> #22 0x00007f540738f567 in connection_threadmain ()
>> #23 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
>> #24 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
>> #25 0x00007f540476d28d in clone () from /lib64/libc.so.6
>> Thread 26 (Thread 0x7f53d77f6700 (LWP 128220)):
>> #0 0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
>> /lib64/libpthread.so.0
>> #1 0x00007f53fef9f2f3 in __db_hybrid_mutex_suspend () from /lib64/
>> libdb-5.3.so
>> #2 0x00007f53fef9e640 in __db_tas_mutex_lock () from /lib64/libdb-5.3.so
>> #3 0x00007f53ff048d3a in __lock_get_internal () from /lib64/libdb-5.3.so
>> #4 0x00007f53ff049820 in __lock_get () from /lib64/libdb-5.3.so
>> #5 0x00007f53ff075142 in __db_lget () from /lib64/libdb-5.3.so
>> #6 0x00007f53fefbc605 in __bam_search () from /lib64/libdb-5.3.so
>> #7 0x00007f53fefa7256 in __bamc_search () from /lib64/libdb-5.3.so
>> #8 0x00007f53fefa8d0f in __bamc_get () from /lib64/libdb-5.3.so
>> #9 0x00007f53ff061ca6 in __dbc_iget () from /lib64/libdb-5.3.so
>> #10 0x00007f53ff070b02 in __dbc_get_pp () from /lib64/libdb-5.3.so
>> #11 0x00007f53fa54c680 in idl_new_fetch () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #12 0x00007f53fa55ab26 in index_read_ext_allids () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #13 0x00007f53fa545284 in keys2idl () from /usr/lib64/dirsrv/plugins/libb
>> ack-ldbm.so
>> #14 0x00007f53fa5459e3 in ava_candidates.isra.0 () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #15 0x00007f53fa545fd2 in filter_candidates_ext () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #16 0x00007f53fa547096 in list_candidates () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #17 0x00007f53fa545f40 in filter_candidates_ext () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #18 0x00007f53fa58180c in subtree_candidates () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #19 0x00007f53fa582e7f in ldbm_back_search () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #20 0x00007f5406eb01d6 in op_shared_search () from
>> /usr/lib64/dirsrv/libslapd.so.0
>> #21 0x00007f54073a133e in do_search ()
>> #22 0x00007f540738f567 in connection_threadmain ()
>> #23 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
>> #24 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
>> #25 0x00007f540476d28d in clone () from /lib64/libc.so.6
>> Thread 25 (Thread 0x7f53d6ff5700 (LWP 128221)):
>> #0 0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
>> /lib64/libpthread.so.0
>> #1 0x00007f53fef9f2f3 in __db_hybrid_mutex_suspend () from /lib64/
>> libdb-5.3.so
>> #2 0x00007f53fef9e640 in __db_tas_mutex_lock () from /lib64/libdb-5.3.so
>> #3 0x00007f53ff048d3a in __lock_get_internal () from /lib64/libdb-5.3.so
>> #4 0x00007f53ff049820 in __lock_get () from /lib64/libdb-5.3.so
>> #5 0x00007f53ff075142 in __db_lget () from /lib64/libdb-5.3.so
>> #6 0x00007f53fefbc605 in __bam_search () from /lib64/libdb-5.3.so
>> #7 0x00007f53fefa7256 in __bamc_search () from /lib64/libdb-5.3.so
>> #8 0x00007f53fefa8d0f in __bamc_get () from /lib64/libdb-5.3.so
>> #9 0x00007f53ff061ca6 in __dbc_iget () from /lib64/libdb-5.3.so
>> #10 0x00007f53ff070b02 in __dbc_get_pp () from /lib64/libdb-5.3.so
>> #11 0x00007f53fa54c680 in idl_new_fetch () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #12 0x00007f53fa55ab26 in index_read_ext_allids () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #13 0x00007f53fa545284 in keys2idl () from /usr/lib64/dirsrv/plugins/libb
>> ack-ldbm.so
>> #14 0x00007f53fa5459e3 in ava_candidates.isra.0 () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #15 0x00007f53fa545fd2 in filter_candidates_ext () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #16 0x00007f53fa547096 in list_candidates () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #17 0x00007f53fa545f40 in filter_candidates_ext () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #18 0x00007f53fa58180c in subtree_candidates () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #19 0x00007f53fa582e7f in ldbm_back_search () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #20 0x00007f5406eb01d6 in op_shared_search () from
>> /usr/lib64/dirsrv/libslapd.so.0
>> #21 0x00007f54073a133e in do_search ()
>> #22 0x00007f540738f567 in connection_threadmain ()
>> #23 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
>> #24 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
>> #25 0x00007f540476d28d in clone () from /lib64/libc.so.6
>> Thread 24 (Thread 0x7f53d67f4700 (LWP 128222)):
>> #0 0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
>> /lib64/libpthread.so.0
>> #1 0x00007f53fef9f2f3 in __db_hybrid_mutex_suspend () from /lib64/
>> libdb-5.3.so
>> #2 0x00007f53fef9e640 in __db_tas_mutex_lock () from /lib64/libdb-5.3.so
>> #3 0x00007f53ff048d3a in __lock_get_internal () from /lib64/libdb-5.3.so
>> #4 0x00007f53ff049820 in __lock_get () from /lib64/libdb-5.3.so
>> #5 0x00007f53ff075142 in __db_lget () from /lib64/libdb-5.3.so
>> #6 0x00007f53fefbc605 in __bam_search () from /lib64/libdb-5.3.so
>> #7 0x00007f53fefa7256 in __bamc_search () from /lib64/libdb-5.3.so
>> #8 0x00007f53fefa8d0f in __bamc_get () from /lib64/libdb-5.3.so
>> #9 0x00007f53ff061ca6 in __dbc_iget () from /lib64/libdb-5.3.so
>> #10 0x00007f53ff070b02 in __dbc_get_pp () from /lib64/libdb-5.3.so
>> #11 0x00007f53fa54c680 in idl_new_fetch () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #12 0x00007f53fa55ab26 in index_read_ext_allids () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #13 0x00007f53fa545284 in keys2idl () from /usr/lib64/dirsrv/plugins/libb
>> ack-ldbm.so
>> #14 0x00007f53fa5459e3 in ava_candidates.isra.0 () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #15 0x00007f53fa545fd2 in filter_candidates_ext () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #16 0x00007f53fa547096 in list_candidates () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #17 0x00007f53fa545f40 in filter_candidates_ext () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #18 0x00007f53fa58180c in subtree_candidates () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #19 0x00007f53fa582e7f in ldbm_back_search () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #20 0x00007f5406eb01d6 in op_shared_search () from
>> /usr/lib64/dirsrv/libslapd.so.0
>> #21 0x00007f54073a133e in do_search ()
>> #22 0x00007f540738f567 in connection_threadmain ()
>> #23 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
>> #24 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
>> #25 0x00007f540476d28d in clone () from /lib64/libc.so.6
>> Thread 23 (Thread 0x7f53d5ff3700 (LWP 128223)):
>> #0 0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
>> /lib64/libpthread.so.0
>> #1 0x00007f53fef9f2f3 in __db_hybrid_mutex_suspend () from /lib64/
>> libdb-5.3.so
>> #2 0x00007f53fef9e640 in __db_tas_mutex_lock () from /lib64/libdb-5.3.so
>> #3 0x00007f53ff0b8e1b in __memp_fget () from /lib64/libdb-5.3.so
>> #4 0x00007f53fefbc211 in __bam_search () from /lib64/libdb-5.3.so
>> #5 0x00007f53fefa7256 in __bamc_search () from /lib64/libdb-5.3.so
>> #6 0x00007f53fefab6c4 in __bamc_put () from /lib64/libdb-5.3.so
>> #7 0x00007f53ff0626d5 in __dbc_iput () from /lib64/libdb-5.3.so
>> #8 0x00007f53ff05da0e in __db_put () from /lib64/libdb-5.3.so
>> #9 0x00007f53ff072fa4 in __db_put_pp () from /lib64/libdb-5.3.so
>> #10 0x00007f53fa54d4cf in idl_new_insert_key () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #11 0x00007f53fa55c5b5 in addordel_values_sv.isra.3 () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #12 0x00007f53fa55d25a in index_addordel_values_ext_sv () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #13 0x00007f53fa55d694 in index_addordel_values_sv () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #14 0x00007f53fa55d75a in index_addordel_entry () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #15 0x00007f53fa5605fa in ldbm_back_add () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #16 0x00007f5406e62cca in op_shared_add () from
>> /usr/lib64/dirsrv/libslapd.so.0
>> #17 0x00007f5406e64020 in do_add () from /usr/lib64/dirsrv/libslapd.so.0
>> #18 0x00007f540738f303 in connection_threadmain ()
>> #19 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
>> #20 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
>> #21 0x00007f540476d28d in clone () from /lib64/libc.so.6
>> Thread 22 (Thread 0x7f53d57f2700 (LWP 128224)):
>> #0 0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
>> /lib64/libpthread.so.0
>> #1 0x00007f53fef9f2f3 in __db_hybrid_mutex_suspend () from /lib64/
>> libdb-5.3.so
>> #2 0x00007f53fef9e640 in __db_tas_mutex_lock () from /lib64/libdb-5.3.so
>> #3 0x00007f53ff048d3a in __lock_get_internal () from /lib64/libdb-5.3.so
>> #4 0x00007f53ff049820 in __lock_get () from /lib64/libdb-5.3.so
>> #5 0x00007f53ff075142 in __db_lget () from /lib64/libdb-5.3.so
>> #6 0x00007f53fefbc605 in __bam_search () from /lib64/libdb-5.3.so
>> #7 0x00007f53fefa7256 in __bamc_search () from /lib64/libdb-5.3.so
>> #8 0x00007f53fefa8d0f in __bamc_get () from /lib64/libdb-5.3.so
>> #9 0x00007f53ff061ca6 in __dbc_iget () from /lib64/libdb-5.3.so
>> #10 0x00007f53ff070b02 in __dbc_get_pp () from /lib64/libdb-5.3.so
>> #11 0x00007f53fa54c680 in idl_new_fetch () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #12 0x00007f53fa55ab26 in index_read_ext_allids () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #13 0x00007f53fa545284 in keys2idl () from /usr/lib64/dirsrv/plugins/libb
>> ack-ldbm.so
>> #14 0x00007f53fa5459e3 in ava_candidates.isra.0 () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #15 0x00007f53fa545fd2 in filter_candidates_ext () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #16 0x00007f53fa547096 in list_candidates () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #17 0x00007f53fa545f40 in filter_candidates_ext () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #18 0x00007f53fa58180c in subtree_candidates () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #19 0x00007f53fa582e7f in ldbm_back_search () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #20 0x00007f5406eb01d6 in op_shared_search () from
>> /usr/lib64/dirsrv/libslapd.so.0
>> #21 0x00007f54073a133e in do_search ()
>> #22 0x00007f540738f567 in connection_threadmain ()
>> #23 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
>> #24 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
>> #25 0x00007f540476d28d in clone () from /lib64/libc.so.6
>> Thread 21 (Thread 0x7f53d4ff1700 (LWP 128225)):
>> #0 0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
>> /lib64/libpthread.so.0
>> #1 0x00007f53fef9f2f3 in __db_hybrid_mutex_suspend () from /lib64/
>> libdb-5.3.so
>> #2 0x00007f53fef9e640 in __db_tas_mutex_lock () from /lib64/libdb-5.3.so
>> #3 0x00007f53ff048d3a in __lock_get_internal () from /lib64/libdb-5.3.so
>> #4 0x00007f53ff049820 in __lock_get () from /lib64/libdb-5.3.so
>> #5 0x00007f53ff075142 in __db_lget () from /lib64/libdb-5.3.so
>> #6 0x00007f53fefbc605 in __bam_search () from /lib64/libdb-5.3.so
>> #7 0x00007f53fefa7256 in __bamc_search () from /lib64/libdb-5.3.so
>> #8 0x00007f53fefa8d0f in __bamc_get () from /lib64/libdb-5.3.so
>> #9 0x00007f53ff061ca6 in __dbc_iget () from /lib64/libdb-5.3.so
>> #10 0x00007f53ff070b02 in __dbc_get_pp () from /lib64/libdb-5.3.so
>> #11 0x00007f53fa54c680 in idl_new_fetch () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #12 0x00007f53fa55ab26 in index_read_ext_allids () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #13 0x00007f53fa545284 in keys2idl () from /usr/lib64/dirsrv/plugins/libb
>> ack-ldbm.so
>> #14 0x00007f53fa5459e3 in ava_candidates.isra.0 () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #15 0x00007f53fa545fd2 in filter_candidates_ext () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #16 0x00007f53fa547096 in list_candidates () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #17 0x00007f53fa545f40 in filter_candidates_ext () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #18 0x00007f53fa58180c in subtree_candidates () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #19 0x00007f53fa582e7f in ldbm_back_search () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #20 0x00007f5406eb01d6 in op_shared_search () from
>> /usr/lib64/dirsrv/libslapd.so.0
>> #21 0x00007f54073a133e in do_search ()
>> #22 0x00007f540738f567 in connection_threadmain ()
>> #23 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
>> #24 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
>> #25 0x00007f540476d28d in clone () from /lib64/libc.so.6
>> Thread 20 (Thread 0x7f53d47f0700 (LWP 128226)):
>> #0 0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
>> /lib64/libpthread.so.0
>> #1 0x00007f53fef9f2f3 in __db_hybrid_mutex_suspend () from /lib64/
>> libdb-5.3.so
>> #2 0x00007f53fef9e640 in __db_tas_mutex_lock () from /lib64/libdb-5.3.so
>> #3 0x00007f53ff048d3a in __lock_get_internal () from /lib64/libdb-5.3.so
>> #4 0x00007f53ff049820 in __lock_get () from /lib64/libdb-5.3.so
>> #5 0x00007f53ff075142 in __db_lget () from /lib64/libdb-5.3.so
>> #6 0x00007f53fefbc605 in __bam_search () from /lib64/libdb-5.3.so
>> #7 0x00007f53fefa7256 in __bamc_search () from /lib64/libdb-5.3.so
>> #8 0x00007f53fefa8d0f in __bamc_get () from /lib64/libdb-5.3.so
>> #9 0x00007f53ff061ca6 in __dbc_iget () from /lib64/libdb-5.3.so
>> #10 0x00007f53ff070b02 in __dbc_get_pp () from /lib64/libdb-5.3.so
>> #11 0x00007f53fa54c680 in idl_new_fetch () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #12 0x00007f53fa55ab26 in index_read_ext_allids () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #13 0x00007f53fa545284 in keys2idl () from /usr/lib64/dirsrv/plugins/libb
>> ack-ldbm.so
>> #14 0x00007f53fa5459e3 in ava_candidates.isra.0 () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #15 0x00007f53fa545fd2 in filter_candidates_ext () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #16 0x00007f53fa547096 in list_candidates () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #17 0x00007f53fa545f40 in filter_candidates_ext () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #18 0x00007f53fa58180c in subtree_candidates () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #19 0x00007f53fa582e7f in ldbm_back_search () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #20 0x00007f5406eb01d6 in op_shared_search () from
>> /usr/lib64/dirsrv/libslapd.so.0
>> #21 0x00007f5406ec094e in search_internal_callback_pb () from
>> /usr/lib64/dirsrv/libslapd.so.0
>> #22 0x00007f5406ec0be8 in search_internal_pb () from
>> /usr/lib64/dirsrv/libslapd.so.0
>> #23 0x00007f53fe118e90 in search_one_berval () from
>> /usr/lib64/dirsrv/plugins/libattr-unique-plugin.so
>> #24 0x00007f53fe119242 in search () from /usr/lib64/dirsrv/plugins/liba
>> ttr-unique-plugin.so
>> #25 0x00007f53fe11954c in searchAllSubtrees () from
>> /usr/lib64/dirsrv/plugins/libattr-unique-plugin.so
>> #26 0x00007f53fe11a015 in preop_add () from /usr/lib64/dirsrv/plugins/liba
>> ttr-unique-plugin.so
>> #27 0x00007f5406ebb848 in plugin_call_func () from
>> /usr/lib64/dirsrv/libslapd.so.0
>> #28 0x00007f5406ebbb13 in plugin_call_plugins () from
>> /usr/lib64/dirsrv/libslapd.so.0
>> #29 0x00007f5406e62c2b in op_shared_add () from
>> /usr/lib64/dirsrv/libslapd.so.0
>> #30 0x00007f5406e64020 in do_add () from /usr/lib64/dirsrv/libslapd.so.0
>> #31 0x00007f540738f303 in connection_threadmain ()
>> #32 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
>> #33 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
>> #34 0x00007f540476d28d in clone () from /lib64/libc.so.6
>> Thread 19 (Thread 0x7f53d3fef700 (LWP 128227)):
>> #0 0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
>> /lib64/libpthread.so.0
>> #1 0x00007f53fef9f2f3 in __db_hybrid_mutex_suspend () from /lib64/
>> libdb-5.3.so
>> #2 0x00007f53fef9e640 in __db_tas_mutex_lock () from /lib64/libdb-5.3.so
>> #3 0x00007f53ff048d3a in __lock_get_internal () from /lib64/libdb-5.3.so
>> #4 0x00007f53ff049820 in __lock_get () from /lib64/libdb-5.3.so
>> #5 0x00007f53ff075142 in __db_lget () from /lib64/libdb-5.3.so
>> #6 0x00007f53fefbc605 in __bam_search () from /lib64/libdb-5.3.so
>> #7 0x00007f53fefa7256 in __bamc_search () from /lib64/libdb-5.3.so
>> #8 0x00007f53fefa8d0f in __bamc_get () from /lib64/libdb-5.3.so
>> #9 0x00007f53ff061ca6 in __dbc_iget () from /lib64/libdb-5.3.so
>> #10 0x00007f53ff070b02 in __dbc_get_pp () from /lib64/libdb-5.3.so
>> #11 0x00007f53fa54c680 in idl_new_fetch () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #12 0x00007f53fa55ab26 in index_read_ext_allids () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #13 0x00007f53fa545284 in keys2idl () from /usr/lib64/dirsrv/plugins/libb
>> ack-ldbm.so
>> #14 0x00007f53fa5459e3 in ava_candidates.isra.0 () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #15 0x00007f53fa545fd2 in filter_candidates_ext () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #16 0x00007f53fa547096 in list_candidates () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #17 0x00007f53fa545f40 in filter_candidates_ext () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #18 0x00007f53fa58180c in subtree_candidates () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #19 0x00007f53fa582e7f in ldbm_back_search () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #20 0x00007f5406eb01d6 in op_shared_search () from
>> /usr/lib64/dirsrv/libslapd.so.0
>> #21 0x00007f54073a133e in do_search ()
>> #22 0x00007f540738f567 in connection_threadmain ()
>> #23 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
>> #24 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
>> #25 0x00007f540476d28d in clone () from /lib64/libc.so.6
>> Thread 18 (Thread 0x7f53d37ee700 (LWP 128228)):
>> #0 0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
>> /lib64/libpthread.so.0
>> #1 0x00007f53fef9f2f3 in __db_hybrid_mutex_suspend () from /lib64/
>> libdb-5.3.so
>> #2 0x00007f53fef9e640 in __db_tas_mutex_lock () from /lib64/libdb-5.3.so
>> #3 0x00007f53ff048d3a in __lock_get_internal () from /lib64/libdb-5.3.so
>> #4 0x00007f53ff049820 in __lock_get () from /lib64/libdb-5.3.so
>> #5 0x00007f53ff075142 in __db_lget () from /lib64/libdb-5.3.so
>> #6 0x00007f53fefbc605 in __bam_search () from /lib64/libdb-5.3.so
>> #7 0x00007f53fefa7256 in __bamc_search () from /lib64/libdb-5.3.so
>> #8 0x00007f53fefa8d0f in __bamc_get () from /lib64/libdb-5.3.so
>> #9 0x00007f53ff061ca6 in __dbc_iget () from /lib64/libdb-5.3.so
>> #10 0x00007f53ff070b02 in __dbc_get_pp () from /lib64/libdb-5.3.so
>> #11 0x00007f53fa54c680 in idl_new_fetch () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #12 0x00007f53fa55ab26 in index_read_ext_allids () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #13 0x00007f53fa545284 in keys2idl () from /usr/lib64/dirsrv/plugins/libb
>> ack-ldbm.so
>> #14 0x00007f53fa5459e3 in ava_candidates.isra.0 () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #15 0x00007f53fa545fd2 in filter_candidates_ext () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #16 0x00007f53fa547096 in list_candidates () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #17 0x00007f53fa545f40 in filter_candidates_ext () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #18 0x00007f53fa58180c in subtree_candidates () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #19 0x00007f53fa582e7f in ldbm_back_search () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #20 0x00007f5406eb01d6 in op_shared_search () from
>> /usr/lib64/dirsrv/libslapd.so.0
>> #21 0x00007f54073a133e in do_search ()
>> #22 0x00007f540738f567 in connection_threadmain ()
>> #23 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
>> #24 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
>> #25 0x00007f540476d28d in clone () from /lib64/libc.so.6
>> Thread 17 (Thread 0x7f53d2fed700 (LWP 128229)):
>> #0 0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
>> /lib64/libpthread.so.0
>> #1 0x00007f53fef9f2f3 in __db_hybrid_mutex_suspend () from /lib64/
>> libdb-5.3.so
>> #2 0x00007f53fef9e640 in __db_tas_mutex_lock () from /lib64/libdb-5.3.so
>> #3 0x00007f53ff048d3a in __lock_get_internal () from /lib64/libdb-5.3.so
>> #4 0x00007f53ff049820 in __lock_get () from /lib64/libdb-5.3.so
>> #5 0x00007f53ff075142 in __db_lget () from /lib64/libdb-5.3.so
>> #6 0x00007f53fefbc605 in __bam_search () from /lib64/libdb-5.3.so
>> #7 0x00007f53fefa7256 in __bamc_search () from /lib64/libdb-5.3.so
>> #8 0x00007f53fefa8d0f in __bamc_get () from /lib64/libdb-5.3.so
>> #9 0x00007f53ff061ca6 in __dbc_iget () from /lib64/libdb-5.3.so
>> #10 0x00007f53ff070b02 in __dbc_get_pp () from /lib64/libdb-5.3.so
>> #11 0x00007f53fa54c680 in idl_new_fetch () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #12 0x00007f53fa55ab26 in index_read_ext_allids () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #13 0x00007f53fa545284 in keys2idl () from /usr/lib64/dirsrv/plugins/libb
>> ack-ldbm.so
>> #14 0x00007f53fa5459e3 in ava_candidates.isra.0 () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #15 0x00007f53fa545fd2 in filter_candidates_ext () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #16 0x00007f53fa547096 in list_candidates () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #17 0x00007f53fa545f40 in filter_candidates_ext () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #18 0x00007f53fa58180c in subtree_candidates () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #19 0x00007f53fa582e7f in ldbm_back_search () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #20 0x00007f5406eb01d6 in op_shared_search () from
>> /usr/lib64/dirsrv/libslapd.so.0
>> #21 0x00007f54073a133e in do_search ()
>> #22 0x00007f540738f567 in connection_threadmain ()
>> #23 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
>> #24 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
>> #25 0x00007f540476d28d in clone () from /lib64/libc.so.6
>> Thread 16 (Thread 0x7f53d27ec700 (LWP 128230)):
>> #0 0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
>> /lib64/libpthread.so.0
>> #1 0x00007f53fef9f2f3 in __db_hybrid_mutex_suspend () from /lib64/
>> libdb-5.3.so
>> #2 0x00007f53fef9e640 in __db_tas_mutex_lock () from /lib64/libdb-5.3.so
>> #3 0x00007f53ff048d3a in __lock_get_internal () from /lib64/libdb-5.3.so
>> #4 0x00007f53ff049820 in __lock_get () from /lib64/libdb-5.3.so
>> #5 0x00007f53ff075142 in __db_lget () from /lib64/libdb-5.3.so
>> #6 0x00007f53fefbc605 in __bam_search () from /lib64/libdb-5.3.so
>> #7 0x00007f53fefa7256 in __bamc_search () from /lib64/libdb-5.3.so
>> #8 0x00007f53fefa8d0f in __bamc_get () from /lib64/libdb-5.3.so
>> #9 0x00007f53ff061ca6 in __dbc_iget () from /lib64/libdb-5.3.so
>> #10 0x00007f53ff070b02 in __dbc_get_pp () from /lib64/libdb-5.3.so
>> #11 0x00007f53fa54c680 in idl_new_fetch () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #12 0x00007f53fa55ab26 in index_read_ext_allids () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #13 0x00007f53fa545284 in keys2idl () from /usr/lib64/dirsrv/plugins/libb
>> ack-ldbm.so
>> #14 0x00007f53fa5459e3 in ava_candidates.isra.0 () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #15 0x00007f53fa545fd2 in filter_candidates_ext () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #16 0x00007f53fa547096 in list_candidates () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #17 0x00007f53fa545f40 in filter_candidates_ext () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #18 0x00007f53fa58180c in subtree_candidates () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #19 0x00007f53fa582e7f in ldbm_back_search () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #20 0x00007f5406eb01d6 in op_shared_search () from
>> /usr/lib64/dirsrv/libslapd.so.0
>> #21 0x00007f54073a133e in do_search ()
>> #22 0x00007f540738f567 in connection_threadmain ()
>> #23 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
>> #24 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
>> #25 0x00007f540476d28d in clone () from /lib64/libc.so.6
>> Thread 15 (Thread 0x7f53d1feb700 (LWP 128231)):
>> #0 0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
>> /lib64/libpthread.so.0
>> #1 0x00007f53fef9f2f3 in __db_hybrid_mutex_suspend () from /lib64/
>> libdb-5.3.so
>> #2 0x00007f53fef9e640 in __db_tas_mutex_lock () from /lib64/libdb-5.3.so
>> #3 0x00007f53ff048d3a in __lock_get_internal () from /lib64/libdb-5.3.so
>> #4 0x00007f53ff049820 in __lock_get () from /lib64/libdb-5.3.so
>> #5 0x00007f53ff075142 in __db_lget () from /lib64/libdb-5.3.so
>> #6 0x00007f53fefbc605 in __bam_search () from /lib64/libdb-5.3.so
>> #7 0x00007f53fefa7256 in __bamc_search () from /lib64/libdb-5.3.so
>> #8 0x00007f53fefa8d0f in __bamc_get () from /lib64/libdb-5.3.so
>> #9 0x00007f53ff061ca6 in __dbc_iget () from /lib64/libdb-5.3.so
>> #10 0x00007f53ff070b02 in __dbc_get_pp () from /lib64/libdb-5.3.so
>> #11 0x00007f53fa54c680 in idl_new_fetch () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #12 0x00007f53fa55ab26 in index_read_ext_allids () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #13 0x00007f53fa545284 in keys2idl () from /usr/lib64/dirsrv/plugins/libb
>> ack-ldbm.so
>> #14 0x00007f53fa5459e3 in ava_candidates.isra.0 () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #15 0x00007f53fa545fd2 in filter_candidates_ext () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #16 0x00007f53fa547096 in list_candidates () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #17 0x00007f53fa545f40 in filter_candidates_ext () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #18 0x00007f53fa58180c in subtree_candidates () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #19 0x00007f53fa582e7f in ldbm_back_search () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #20 0x00007f5406eb01d6 in op_shared_search () from
>> /usr/lib64/dirsrv/libslapd.so.0
>> #21 0x00007f54073a133e in do_search ()
>> #22 0x00007f540738f567 in connection_threadmain ()
>> #23 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
>> #24 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
>> #25 0x00007f540476d28d in clone () from /lib64/libc.so.6
>> Thread 14 (Thread 0x7f53d17ea700 (LWP 128232)):
>> #0 0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
>> /lib64/libpthread.so.0
>> #1 0x00007f53fef9f2f3 in __db_hybrid_mutex_suspend () from /lib64/
>> libdb-5.3.so
>> #2 0x00007f53fef9e640 in __db_tas_mutex_lock () from /lib64/libdb-5.3.so
>> #3 0x00007f53ff048d3a in __lock_get_internal () from /lib64/libdb-5.3.so
>> #4 0x00007f53ff049820 in __lock_get () from /lib64/libdb-5.3.so
>> #5 0x00007f53ff075142 in __db_lget () from /lib64/libdb-5.3.so
>> #6 0x00007f53fefbc605 in __bam_search () from /lib64/libdb-5.3.so
>> #7 0x00007f53fefa7256 in __bamc_search () from /lib64/libdb-5.3.so
>> #8 0x00007f53fefa8d0f in __bamc_get () from /lib64/libdb-5.3.so
>> #9 0x00007f53ff061ca6 in __dbc_iget () from /lib64/libdb-5.3.so
>> #10 0x00007f53ff070b02 in __dbc_get_pp () from /lib64/libdb-5.3.so
>> #11 0x00007f53fa54c680 in idl_new_fetch () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #12 0x00007f53fa55ab26 in index_read_ext_allids () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #13 0x00007f53fa545284 in keys2idl () from /usr/lib64/dirsrv/plugins/libb
>> ack-ldbm.so
>> #14 0x00007f53fa5459e3 in ava_candidates.isra.0 () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #15 0x00007f53fa545fd2 in filter_candidates_ext () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #16 0x00007f53fa547096 in list_candidates () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #17 0x00007f53fa545f40 in filter_candidates_ext () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #18 0x00007f53fa547096 in list_candidates () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #19 0x00007f53fa545f40 in filter_candidates_ext () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #20 0x00007f53fa547096 in list_candidates () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #21 0x00007f53fa545f40 in filter_candidates_ext () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #22 0x00007f53fa58180c in subtree_candidates () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #23 0x00007f53fa582e7f in ldbm_back_search () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #24 0x00007f5406eb01d6 in op_shared_search () from
>> /usr/lib64/dirsrv/libslapd.so.0
>> #25 0x00007f54073a133e in do_search ()
>> #26 0x00007f540738f3c3 in connection_threadmain ()
>> #27 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
>> #28 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
>> #29 0x00007f540476d28d in clone () from /lib64/libc.so.6
>> Thread 13 (Thread 0x7f53d0fe9700 (LWP 128233)):
>> #0 0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
>> /lib64/libpthread.so.0
>> #1 0x00007f53fef9f2f3 in __db_hybrid_mutex_suspend () from /lib64/
>> libdb-5.3.so
>> #2 0x00007f53fef9e640 in __db_tas_mutex_lock () from /lib64/libdb-5.3.so
>> #3 0x00007f53ff048d3a in __lock_get_internal () from /lib64/libdb-5.3.so
>> #4 0x00007f53ff049820 in __lock_get () from /lib64/libdb-5.3.so
>> #5 0x00007f53ff075142 in __db_lget () from /lib64/libdb-5.3.so
>> #6 0x00007f53fefbc605 in __bam_search () from /lib64/libdb-5.3.so
>> #7 0x00007f53fefa7256 in __bamc_search () from /lib64/libdb-5.3.so
>> #8 0x00007f53fefa8d0f in __bamc_get () from /lib64/libdb-5.3.so
>> #9 0x00007f53ff061ca6 in __dbc_iget () from /lib64/libdb-5.3.so
>> #10 0x00007f53ff070b02 in __dbc_get_pp () from /lib64/libdb-5.3.so
>> #11 0x00007f53fa54c680 in idl_new_fetch () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #12 0x00007f53fa55ab26 in index_read_ext_allids () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #13 0x00007f53fa545284 in keys2idl () from /usr/lib64/dirsrv/plugins/libb
>> ack-ldbm.so
>> #14 0x00007f53fa5459e3 in ava_candidates.isra.0 () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #15 0x00007f53fa545fd2 in filter_candidates_ext () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #16 0x00007f53fa547096 in list_candidates () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #17 0x00007f53fa545f40 in filter_candidates_ext () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #18 0x00007f53fa58180c in subtree_candidates () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #19 0x00007f53fa582e7f in ldbm_back_search () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #20 0x00007f5406eb01d6 in op_shared_search () from
>> /usr/lib64/dirsrv/libslapd.so.0
>> #21 0x00007f54073a133e in do_search ()
>> #22 0x00007f540738f567 in connection_threadmain ()
>> #23 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
>> #24 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
>> #25 0x00007f540476d28d in clone () from /lib64/libc.so.6
>> Thread 12 (Thread 0x7f53d07e8700 (LWP 128234)):
>> #0 0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
>> /lib64/libpthread.so.0
>> #1 0x00007f53fef9f2f3 in __db_hybrid_mutex_suspend () from /lib64/
>> libdb-5.3.so
>> #2 0x00007f53fef9e640 in __db_tas_mutex_lock () from /lib64/libdb-5.3.so
>> #3 0x00007f53ff048d3a in __lock_get_internal () from /lib64/libdb-5.3.so
>> #4 0x00007f53ff049820 in __lock_get () from /lib64/libdb-5.3.so
>> #5 0x00007f53ff075142 in __db_lget () from /lib64/libdb-5.3.so
>> #6 0x00007f53fefbc605 in __bam_search () from /lib64/libdb-5.3.so
>> #7 0x00007f53fefa7256 in __bamc_search () from /lib64/libdb-5.3.so
>> #8 0x00007f53fefa8d0f in __bamc_get () from /lib64/libdb-5.3.so
>> #9 0x00007f53ff061ca6 in __dbc_iget () from /lib64/libdb-5.3.so
>> #10 0x00007f53ff070b02 in __dbc_get_pp () from /lib64/libdb-5.3.so
>> #11 0x00007f53fa54c680 in idl_new_fetch () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #12 0x00007f53fa55ab26 in index_read_ext_allids () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #13 0x00007f53fa545284 in keys2idl () from /usr/lib64/dirsrv/plugins/libb
>> ack-ldbm.so
>> #14 0x00007f53fa5459e3 in ava_candidates.isra.0 () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #15 0x00007f53fa545fd2 in filter_candidates_ext () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #16 0x00007f53fa547096 in list_candidates () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #17 0x00007f53fa545f40 in filter_candidates_ext () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #18 0x00007f53fa58180c in subtree_candidates () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #19 0x00007f53fa582e7f in ldbm_back_search () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #20 0x00007f5406eb01d6 in op_shared_search () from
>> /usr/lib64/dirsrv/libslapd.so.0
>> #21 0x00007f54073a133e in do_search ()
>> #22 0x00007f540738f567 in connection_threadmain ()
>> #23 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
>> #24 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
>> #25 0x00007f540476d28d in clone () from /lib64/libc.so.6
>> Thread 11 (Thread 0x7f53cffe7700 (LWP 128235)):
>> #0 0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
>> /lib64/libpthread.so.0
>> #1 0x00007f53fef9f2f3 in __db_hybrid_mutex_suspend () from /lib64/
>> libdb-5.3.so
>> #2 0x00007f53fef9e640 in __db_tas_mutex_lock () from /lib64/libdb-5.3.so
>> #3 0x00007f53ff048d3a in __lock_get_internal () from /lib64/libdb-5.3.so
>> #4 0x00007f53ff049820 in __lock_get () from /lib64/libdb-5.3.so
>> #5 0x00007f53ff075142 in __db_lget () from /lib64/libdb-5.3.so
>> #6 0x00007f53fefbc605 in __bam_search () from /lib64/libdb-5.3.so
>> #7 0x00007f53fefa7256 in __bamc_search () from /lib64/libdb-5.3.so
>> #8 0x00007f53fefa8d0f in __bamc_get () from /lib64/libdb-5.3.so
>> #9 0x00007f53ff061ca6 in __dbc_iget () from /lib64/libdb-5.3.so
>> #10 0x00007f53ff070b02 in __dbc_get_pp () from /lib64/libdb-5.3.so
>> #11 0x00007f53fa54c680 in idl_new_fetch () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #12 0x00007f53fa55ab26 in index_read_ext_allids () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #13 0x00007f53fa545284 in keys2idl () from /usr/lib64/dirsrv/plugins/libb
>> ack-ldbm.so
>> #14 0x00007f53fa5459e3 in ava_candidates.isra.0 () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #15 0x00007f53fa545fd2 in filter_candidates_ext () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #16 0x00007f53fa547096 in list_candidates () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #17 0x00007f53fa545f40 in filter_candidates_ext () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #18 0x00007f53fa58180c in subtree_candidates () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #19 0x00007f53fa582e7f in ldbm_back_search () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #20 0x00007f5406eb01d6 in op_shared_search () from
>> /usr/lib64/dirsrv/libslapd.so.0
>> #21 0x00007f54073a133e in do_search ()
>> #22 0x00007f540738f567 in connection_threadmain ()
>> #23 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
>> #24 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
>> #25 0x00007f540476d28d in clone () from /lib64/libc.so.6
>> Thread 10 (Thread 0x7f53cf7e6700 (LWP 128236)):
>> #0 0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
>> /lib64/libpthread.so.0
>> #1 0x00007f53fef9f2f3 in __db_hybrid_mutex_suspend () from /lib64/
>> libdb-5.3.so
>> #2 0x00007f53fef9e640 in __db_tas_mutex_lock () from /lib64/libdb-5.3.so
>> #3 0x00007f53ff048d3a in __lock_get_internal () from /lib64/libdb-5.3.so
>> #4 0x00007f53ff049820 in __lock_get () from /lib64/libdb-5.3.so
>> #5 0x00007f53ff075142 in __db_lget () from /lib64/libdb-5.3.so
>> #6 0x00007f53fefbc605 in __bam_search () from /lib64/libdb-5.3.so
>> #7 0x00007f53fefa7256 in __bamc_search () from /lib64/libdb-5.3.so
>> #8 0x00007f53fefa8d0f in __bamc_get () from /lib64/libdb-5.3.so
>> #9 0x00007f53ff061ca6 in __dbc_iget () from /lib64/libdb-5.3.so
>> #10 0x00007f53ff070b02 in __dbc_get_pp () from /lib64/libdb-5.3.so
>> #11 0x00007f53fa54c680 in idl_new_fetch () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #12 0x00007f53fa55ab26 in index_read_ext_allids () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #13 0x00007f53fa545284 in keys2idl () from /usr/lib64/dirsrv/plugins/libb
>> ack-ldbm.so
>> #14 0x00007f53fa5459e3 in ava_candidates.isra.0 () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #15 0x00007f53fa545fd2 in filter_candidates_ext () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #16 0x00007f53fa547096 in list_candidates () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #17 0x00007f53fa545f40 in filter_candidates_ext () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #18 0x00007f53fa58180c in subtree_candidates () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #19 0x00007f53fa582e7f in ldbm_back_search () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #20 0x00007f5406eb01d6 in op_shared_search () from
>> /usr/lib64/dirsrv/libslapd.so.0
>> #21 0x00007f54073a133e in do_search ()
>> #22 0x00007f540738f567 in connection_threadmain ()
>> #23 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
>> #24 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
>> #25 0x00007f540476d28d in clone () from /lib64/libc.so.6
>> Thread 9 (Thread 0x7f53cefe5700 (LWP 128237)):
>> #0 0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
>> /lib64/libpthread.so.0
>> #1 0x00007f53fef9f2f3 in __db_hybrid_mutex_suspend () from /lib64/
>> libdb-5.3.so
>> #2 0x00007f53fef9e640 in __db_tas_mutex_lock () from /lib64/libdb-5.3.so
>> #3 0x00007f53ff048d3a in __lock_get_internal () from /lib64/libdb-5.3.so
>> #4 0x00007f53ff049820 in __lock_get () from /lib64/libdb-5.3.so
>> #5 0x00007f53ff075142 in __db_lget () from /lib64/libdb-5.3.so
>> #6 0x00007f53fefbc605 in __bam_search () from /lib64/libdb-5.3.so
>> #7 0x00007f53fefa7256 in __bamc_search () from /lib64/libdb-5.3.so
>> #8 0x00007f53fefa8d0f in __bamc_get () from /lib64/libdb-5.3.so
>> #9 0x00007f53ff061ca6 in __dbc_iget () from /lib64/libdb-5.3.so
>> #10 0x00007f53ff070b02 in __dbc_get_pp () from /lib64/libdb-5.3.so
>> #11 0x00007f53fa54c680 in idl_new_fetch () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #12 0x00007f53fa55ab26 in index_read_ext_allids () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #13 0x00007f53fa545284 in keys2idl () from /usr/lib64/dirsrv/plugins/libb
>> ack-ldbm.so
>> #14 0x00007f53fa5459e3 in ava_candidates.isra.0 () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #15 0x00007f53fa545fd2 in filter_candidates_ext () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #16 0x00007f53fa547096 in list_candidates () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #17 0x00007f53fa545f40 in filter_candidates_ext () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #18 0x00007f53fa58180c in subtree_candidates () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #19 0x00007f53fa582e7f in ldbm_back_search () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #20 0x00007f5406eb01d6 in op_shared_search () from
>> /usr/lib64/dirsrv/libslapd.so.0
>> #21 0x00007f54073a133e in do_search ()
>> #22 0x00007f540738f567 in connection_threadmain ()
>> #23 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
>> #24 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
>> #25 0x00007f540476d28d in clone () from /lib64/libc.so.6
>> Thread 8 (Thread 0x7f53ce7e4700 (LWP 128238)):
>> #0 0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
>> /lib64/libpthread.so.0
>> #1 0x00007f53fef9f2f3 in __db_hybrid_mutex_suspend () from /lib64/
>> libdb-5.3.so
>> #2 0x00007f53fef9e640 in __db_tas_mutex_lock () from /lib64/libdb-5.3.so
>> #3 0x00007f53ff048d3a in __lock_get_internal () from /lib64/libdb-5.3.so
>> #4 0x00007f53ff049820 in __lock_get () from /lib64/libdb-5.3.so
>> #5 0x00007f53ff075142 in __db_lget () from /lib64/libdb-5.3.so
>> #6 0x00007f53fefbc605 in __bam_search () from /lib64/libdb-5.3.so
>> #7 0x00007f53fefa7256 in __bamc_search () from /lib64/libdb-5.3.so
>> #8 0x00007f53fefa8d0f in __bamc_get () from /lib64/libdb-5.3.so
>> #9 0x00007f53ff061ca6 in __dbc_iget () from /lib64/libdb-5.3.so
>> #10 0x00007f53ff070b02 in __dbc_get_pp () from /lib64/libdb-5.3.so
>> #11 0x00007f53fa54c680 in idl_new_fetch () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #12 0x00007f53fa55ab26 in index_read_ext_allids () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #13 0x00007f53fa545284 in keys2idl () from /usr/lib64/dirsrv/plugins/libb
>> ack-ldbm.so
>> #14 0x00007f53fa5459e3 in ava_candidates.isra.0 () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #15 0x00007f53fa545fd2 in filter_candidates_ext () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #16 0x00007f53fa547096 in list_candidates () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #17 0x00007f53fa545f40 in filter_candidates_ext () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #18 0x00007f53fa58180c in subtree_candidates () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #19 0x00007f53fa582e7f in ldbm_back_search () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #20 0x00007f5406eb01d6 in op_shared_search () from
>> /usr/lib64/dirsrv/libslapd.so.0
>> #21 0x00007f54073a133e in do_search ()
>> #22 0x00007f540738f567 in connection_threadmain ()
>> #23 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
>> #24 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
>> #25 0x00007f540476d28d in clone () from /lib64/libc.so.6
>> Thread 7 (Thread 0x7f53cdfe3700 (LWP 128239)):
>> #0 0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
>> /lib64/libpthread.so.0
>> #1 0x00007f53fef9f2f3 in __db_hybrid_mutex_suspend () from /lib64/
>> libdb-5.3.so
>> #2 0x00007f53fef9e640 in __db_tas_mutex_lock () from /lib64/libdb-5.3.so
>> #3 0x00007f53ff048d3a in __lock_get_internal () from /lib64/libdb-5.3.so
>> #4 0x00007f53ff049820 in __lock_get () from /lib64/libdb-5.3.so
>> #5 0x00007f53ff075142 in __db_lget () from /lib64/libdb-5.3.so
>> #6 0x00007f53fefbc605 in __bam_search () from /lib64/libdb-5.3.so
>> #7 0x00007f53fefa7256 in __bamc_search () from /lib64/libdb-5.3.so
>> #8 0x00007f53fefa8d0f in __bamc_get () from /lib64/libdb-5.3.so
>> #9 0x00007f53ff061ca6 in __dbc_iget () from /lib64/libdb-5.3.so
>> #10 0x00007f53ff070b02 in __dbc_get_pp () from /lib64/libdb-5.3.so
>> #11 0x00007f53fa54c680 in idl_new_fetch () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #12 0x00007f53fa55ab26 in index_read_ext_allids () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #13 0x00007f53fa545284 in keys2idl () from /usr/lib64/dirsrv/plugins/libb
>> ack-ldbm.so
>> #14 0x00007f53fa5459e3 in ava_candidates.isra.0 () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #15 0x00007f53fa545fd2 in filter_candidates_ext () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #16 0x00007f53fa547096 in list_candidates () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #17 0x00007f53fa545f40 in filter_candidates_ext () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #18 0x00007f53fa58180c in subtree_candidates () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #19 0x00007f53fa582e7f in ldbm_back_search () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #20 0x00007f5406eb01d6 in op_shared_search () from
>> /usr/lib64/dirsrv/libslapd.so.0
>> #21 0x00007f54073a133e in do_search ()
>> #22 0x00007f540738f567 in connection_threadmain ()
>> #23 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
>> #24 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
>> #25 0x00007f540476d28d in clone () from /lib64/libc.so.6
>> Thread 6 (Thread 0x7f53cd7e2700 (LWP 128240)):
>> #0 0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
>> /lib64/libpthread.so.0
>> #1 0x00007f53fef9f2f3 in __db_hybrid_mutex_suspend () from /lib64/
>> libdb-5.3.so
>> #2 0x00007f53fef9eb37 in __db_tas_mutex_readlock () from /lib64/
>> libdb-5.3.so
>> #3 0x00007f53ff0b8d35 in __memp_fget () from /lib64/libdb-5.3.so
>> #4 0x00007f53ff062333 in __dbc_iget () from /lib64/libdb-5.3.so
>> #5 0x00007f53ff070b02 in __dbc_get_pp () from /lib64/libdb-5.3.so
>> #6 0x00007f53fa54c822 in idl_new_fetch () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #7 0x00007f53fa55ab26 in index_read_ext_allids () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #8 0x00007f53fa545284 in keys2idl () from /usr/lib64/dirsrv/plugins/libb
>> ack-ldbm.so
>> #9 0x00007f53fa5459e3 in ava_candidates.isra.0 () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #10 0x00007f53fa545fd2 in filter_candidates_ext () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #11 0x00007f53fa547096 in list_candidates () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #12 0x00007f53fa545f40 in filter_candidates_ext () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #13 0x00007f53fa547096 in list_candidates () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #14 0x00007f53fa545f40 in filter_candidates_ext () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #15 0x00007f53fa547096 in list_candidates () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #16 0x00007f53fa545f40 in filter_candidates_ext () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #17 0x00007f53fa58180c in subtree_candidates () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #18 0x00007f53fa582e7f in ldbm_back_search () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #19 0x00007f5406eb01d6 in op_shared_search () from
>> /usr/lib64/dirsrv/libslapd.so.0
>> #20 0x00007f54073a133e in do_search ()
>> #21 0x00007f540738f3c3 in connection_threadmain ()
>> #22 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
>> #23 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
>> #24 0x00007f540476d28d in clone () from /lib64/libc.so.6
>> Thread 5 (Thread 0x7f53ccfe1700 (LWP 128241)):
>> #0 0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
>> /lib64/libpthread.so.0
>> #1 0x00007f53fef9f2f3 in __db_hybrid_mutex_suspend () from /lib64/
>> libdb-5.3.so
>> #2 0x00007f53fef9e640 in __db_tas_mutex_lock () from /lib64/libdb-5.3.so
>> #3 0x00007f53ff048d3a in __lock_get_internal () from /lib64/libdb-5.3.so
>> #4 0x00007f53ff049820 in __lock_get () from /lib64/libdb-5.3.so
>> #5 0x00007f53ff075142 in __db_lget () from /lib64/libdb-5.3.so
>> #6 0x00007f53fefbc605 in __bam_search () from /lib64/libdb-5.3.so
>> #7 0x00007f53fefa7256 in __bamc_search () from /lib64/libdb-5.3.so
>> #8 0x00007f53fefa8d0f in __bamc_get () from /lib64/libdb-5.3.so
>> #9 0x00007f53ff061ca6 in __dbc_iget () from /lib64/libdb-5.3.so
>> #10 0x00007f53ff070b02 in __dbc_get_pp () from /lib64/libdb-5.3.so
>> #11 0x00007f53fa54c680 in idl_new_fetch () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #12 0x00007f53fa55ab26 in index_read_ext_allids () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #13 0x00007f53fa545284 in keys2idl () from /usr/lib64/dirsrv/plugins/libb
>> ack-ldbm.so
>> #14 0x00007f53fa5459e3 in ava_candidates.isra.0 () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #15 0x00007f53fa545fd2 in filter_candidates_ext () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #16 0x00007f53fa547096 in list_candidates () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #17 0x00007f53fa545f40 in filter_candidates_ext () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #18 0x00007f53fa547096 in list_candidates () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #19 0x00007f53fa545f40 in filter_candidates_ext () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #20 0x00007f53fa547096 in list_candidates () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #21 0x00007f53fa545f40 in filter_candidates_ext () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #22 0x00007f53fa58180c in subtree_candidates () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #23 0x00007f53fa582e7f in ldbm_back_search () from
>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>> #24 0x00007f5406eb01d6 in op_shared_search () from
>> /usr/lib64/dirsrv/libslapd.so.0
>> #25 0x00007f54073a133e in do_search ()
>> #26 0x00007f540738f3c3 in connection_threadmain ()
>> #27 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
>> #28 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
>> #29 0x00007f540476d28d in clone () from /lib64/libc.so.6
>> Thread 4 (Thread 0x7f53cc7e0700 (LWP 128242)):
>> #0 0x00007f54047649b3 in select () from /lib64/libc.so.6
>> #1 0x00007f5406eef0e9 in DS_Sleep () from /usr/lib64/dirsrv/libslapd.so.
>> 0
>> #2 0x00007f5407390325 in time_thread ()
>> #3 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
>> #4 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
>> #5 0x00007f540476d28d in clone () from /lib64/libc.so.6
>> Thread 3 (Thread 0x7f53cb7a0700 (LWP 128259)):
>> #0 0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
>> /lib64/libpthread.so.0
>> #1 0x00007f5405099050 in PR_WaitCondVar () from /lib64/libnspr4.so
>> #2 0x00007f540739bf25 in ps_send_results ()
>> #3 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
>> #4 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
>> #5 0x00007f540476d28d in clone () from /lib64/libc.so.6
>> Thread 2 (Thread 0x7f53cab9d700 (LWP 9020)):
>> #0 0x00007f5404a436d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
>> /lib64/libpthread.so.0
>> #1 0x00007f5405099050 in PR_WaitCondVar () from /lib64/libnspr4.so
>> #2 0x00007f540739bf25 in ps_send_results ()
>> #3 0x00007f540509e7bb in _pt_root () from /lib64/libnspr4.so
>> #4 0x00007f5404a3fdc5 in start_thread () from /lib64/libpthread.so.0
>> #5 0x00007f540476d28d in clone () from /lib64/libc.so.6
>> Thread 1 (Thread 0x7f5407357840 (LWP 128124)):
>> #0 0x00007f5404762c3d in poll () from /lib64/libc.so.6
>> #1 0x00007f540509a967 in _pr_poll_with_poll () from /lib64/libnspr4.so
>> #2 0x00007f5407393ff1 in slapd_daemon ()
>> #3 0x00007f5407385c6c in main ()
>>
>>
>> Thanks
>>
>> On Tue, Sep 6, 2016 at 5:51 PM, Rakesh Rajasekharan <
>> <rakesh.rajasekharan at gmail.com>rakesh.rajasekharan at gmail.com> wrote:
>>
>>> Hi,
>>>
>>> With script provided by Rich, I looked at my db cache usage and it does
>>> not look to be high enough
>>>
>>> # under each db are the list of selected indexes specified with INDEXLIST
>>> dbname count free free% size
>>> changelog:ent 5 2076333 99.0 4163.8
>>> changelog:dn 15976 9303557 88.7 74.0
>>> userroot:ent 4763 175321074 83.6 7221.1
>>> userroot:dn 4763 9995056 95.3 103.0
>>> ipaca:ent 425 6337866 60.4 9759.8
>>> ipaca:dn 425 10451081 99.7 81.6
>>>
>>> Right now I set it to 200MB. So, I am planning to bring it down to 100MB
>>>
>>> Also, *nsslapd-db-checkpoint-interval *will change it to 80 or 90 from
>>> default of 60
>>>
>>> I will check this out and the impact it has on the hang issues and get
>>> back
>>>
>>> Thanks
>>> Rakesh
>>>
>>> On Tue, Sep 6, 2016 at 4:13 PM, Ludwig Krispenz < <lkrispen at redhat.com>
>>> lkrispen at redhat.com> wrote:
>>>
>>>> Hi,
>>>>
>>>> I think you are running into this bug: <https://bugzilla.redhat.com/sh>
>>>> https://bugzilla.redhat.com/show_bug.cgi?id=1349779
>>>> it was the outcome of an analysis started in this one:
>>>> https://bugzilla.redhat.com/show_bug.cgi?id=1347800
>>>>
>>>> the problem is that it looks like the checkpoint thread is holding a
>>>> mutex and otehr threads are blocked on it. It looks like an issue in
>>>> BerkeleyDB although there is no explanation from the BDB code why this
>>>> could happen, we also had a support case with Oracle to investigate this,
>>>> with no solution. Oracle at the end was providing a diagnostic patch, which
>>>> we did not test since the customer with the original problem had worked
>>>> around this by changing their configuration.
>>>> I don't know the status of this patch and if we can make it available,
>>>> probably depends on your support status, you need to contact support for
>>>> this.
>>>>
>>>> About the workarounds:
>>>> you can try to change timing for the database update and checkpointing
>>>> eg by reducing the dbcache size, changing the checkpoint interval. In the
>>>> customer case they identified one substring index, which was frequently
>>>> updated but not really required - and removing this index helped.
>>>>
>>>> Regards,
>>>> Ludwig
>>>>
>>>> On 09/06/2016 11:31 AM, thierry bordaz wrote:
>>>>
>>>> Hi,
>>>>
>>>> The following thread is hanging most of the others threads
>>>>
>>>> Thread 20 (Thread 0x7f68007f8700 (LWP 4873)):
>>>>
>>>> #0 0x00007f683d0506d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>> #1 0x00007f68375ac2f3 in __db_hybrid_mutex_suspend () from /lib64/
>>>> libdb-5.3.so
>>>> #2 0x00007f68375ab640 in __db_tas_mutex_lock () from /lib64/
>>>> libdb-5.3.so
>>>> #3 0x00007f68376c5e1b in __memp_fget () from /lib64/libdb-5.3.so
>>>> #4 0x00007f68375c9211 in __bam_search () from /lib64/libdb-5.3.so
>>>> #5 0x00007f68375b4256 in __bamc_search () from /lib64/libdb-5.3.so
>>>> #6 0x00007f68375b86c4 in __bamc_put () from /lib64/libdb-5.3.so
>>>> #7 0x00007f683766f6d5 in __dbc_iput () from /lib64/libdb-5.3.so
>>>> #8 0x00007f683766aa0e in __db_put () from /lib64/libdb-5.3.so
>>>> #9 0x00007f683767ffa4 in __db_put_pp () from /lib64/libdb-5.3.so
>>>> #10 0x00007f6832b5a4cf in idl_new_insert_key () from
>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>> #11 0x00007f6832b695b5 in addordel_values_sv.isra.3 () from
>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>> #12 0x00007f6832b6a25a in index_addordel_values_ext_sv () from
>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>> #13 0x00007f6832b6a694 in index_addordel_values_sv () from
>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>> #14 0x00007f6832b6a75a in index_addordel_entry () from
>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>> #15 0x00007f6832b6d5fa in ldbm_back_add () from
>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>> #16 0x00007f683f46fcca in op_shared_add () from
>>>> /usr/lib64/dirsrv/libslapd.so.0
>>>> #17 0x00007f683f471020 in do_add () from /usr/lib64/dirsrv/libslapd.so.
>>>> 0
>>>> #18 0x00007f683f99c303 in connection_threadmain ()
>>>> #19 0x00007f683d6ab7bb in _pt_root () from /lib64/libnspr4.so
>>>> #20 0x00007f683d04cdc5 in start_thread () from /lib64/libpthread.so.0
>>>> #21 0x00007f683cd7a28d in clone () from /lib64/libc.so.6
>>>>
>>>> This thread is likely not hang on 'db_tas_mutex_lock' as the db_lock
>>>> does not show it waiting for something.
>>>> Unfortunately it is not shown in the output of top -H, did you get the
>>>> complete output ?
>>>> Ludwig mentioned a known issue that DS is not scaling well on NUMA
>>>> arch, do you know if the machine is NUMA ?
>>>> A possibility is that this thread get severely slowed down by a NUMA
>>>> remote lock and showing DS has hung.
>>>> This is why it would be interesting to know if it consums CPU.
>>>>
>>>> thanks
>>>> theirry
>>>>
>>>> On 09/06/2016 10:59 AM, Rakesh Rajasekharan wrote:
>>>>
>>>> Hi Thierry/Ludwig,
>>>>
>>>> I again hit the hang issue. This is the pstack of the ns-slapd
>>>>
>>>> So was able to this time get the pstack and db locks
>>>>
>>>> db locks details
>>>> Default locking region information:
>>>> 451 Last allocated locker ID
>>>> 0x7fffffff Current maximum unused locker ID
>>>> 9 Number of lock modes
>>>> 800 Initial number of locks allocated
>>>> 0 Initial number of lockers allocated
>>>> 800 Initial number of lock objects allocated
>>>> 10000 Maximum number of locks possible
>>>> 10000 Maximum number of lockers possible
>>>> 10000 Maximum number of lock objects possible
>>>> 800 Current number of locks allocated
>>>> 366 Current number of lockers allocated
>>>> 800 Current number of lock objects allocated
>>>> 160 Number of lock object partitions
>>>> 8191 Size of object hash table
>>>> 126 Number of current locks
>>>> 1005 Maximum number of locks at any one time
>>>> 33 Maximum number of locks in any one bucket
>>>> 3987 Maximum number of locks stolen by for an empty partition
>>>> 75 Maximum number of locks stolen for any one partition
>>>> 309 Number of current lockers
>>>> 313 Maximum number of lockers at any one time
>>>> 121 Number of current lock objects
>>>> 676 Maximum number of lock objects at any one time
>>>> 3 Maximum number of lock objects in any one bucket
>>>> 69 Maximum number of objects stolen by for an empty partition
>>>> 5 Maximum number of objects stolen for any one partition
>>>> 22M Total number of locks requested (22009642)
>>>> 21M Total number of locks released (21992878)
>>>> 0 Total number of locks upgraded
>>>> 95 Total number of locks downgraded
>>>> 3348 Lock requests not available due to conflicts, for which we
>>>> waited
>>>> 12646 Lock requests not available due to conflicts, for which we
>>>> did not wait
>>>> 0 Number of deadlocks
>>>> 0 Lock timeout value
>>>> 0 Number of locks that have timed out
>>>> 0 Transaction timeout value
>>>> 0 Number of transactions that have timed out
>>>> 2MB 560KB Region size
>>>> 71719 The number of partition locks that required waiting (0%)
>>>> 23105 The maximum number of times any partition lock was waited
>>>> for (0%)
>>>> 0 The number of object queue operations that required waiting
>>>> (0%)
>>>> 163 The number of locker allocations that required waiting (0%)
>>>> 3172 The number of region locks that required waiting (0%)
>>>> 5 Maximum hash bucket length
>>>> =-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
>>>> Lock REGINFO information:
>>>> Environment Region type
>>>> 1 Region ID
>>>> /var/lib/dirsrv/slapd-SPRINKLR-COM/db/__db.001 Region name
>>>> 0x7f67ef869000 Region address
>>>> 0x7f67ef8690a0 Region allocation head
>>>> 0x7f67ef8712b0 Region primary address
>>>> 0 Region maximum allocation
>>>> 0 Region allocated
>>>> Region allocations: 1581345 allocations, 0 failures, 1580794 frees, 6
>>>> longest
>>>> Allocations by power-of-two sizes:
>>>> 1KB 1581329
>>>> 2KB 3
>>>> 4KB 4
>>>> 8KB 3
>>>> 16KB 3
>>>> 32KB 1
>>>> 64KB 0
>>>> 128KB 0
>>>> 256KB 2
>>>> 512KB 0
>>>> 1024KB 1
>>>> REGION_SHARED Region flags
>>>> =-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
>>>> Lock region parameters:
>>>> 2 Lock region region mutex [3172/14M 0% !Own] <wakeups 0/1143>
>>>> 16381 locker table size
>>>> 8191 object table size
>>>> 34128 obj_off
>>>> 900216 locker_off
>>>> 0 need_dd
>>>> =-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
>>>> Lock conflict matrix:
>>>> =-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
>>>> Locks grouped by lockers:
>>>> Locker Mode Count Status ----------------- Object
>>>> ---------------
>>>> 2 dd=308 locks held 1 write locks 0 pid/thread
>>>> 4845/140085720139840 flags 10 priority 100
>>>> 2 READ 1 HELD userRoot/id2entry.db
>>>> handle 0
>>>> 3 dd=307 locks held 0 write locks 0 pid/thread
>>>> 4845/140084829472512 flags 0 priority 100
>>>> 4 dd=306 locks held 1 write locks 0 pid/thread
>>>> 4845/140085720139840 flags 10 priority 100
>>>> 4 READ 1 HELD ipaca/id2entry.db
>>>> handle 0
>>>> 5 dd=305 locks held 0 write locks 0 pid/thread
>>>> 4845/140084837865216 flags 0 priority 100
>>>> 6 dd=304 locks held 1 write locks 0 pid/thread
>>>> 4845/140085720139840 flags 10 priority 100
>>>> 6 READ 1 HELD ipaca/entryrdn.db
>>>> handle 0
>>>> 7 dd=303 locks held 0 write locks 0 pid/thread
>>>> 4845/140084804294400 flags 0 priority 100
>>>> 8 dd=302 locks held 0 write locks 0 pid/thread
>>>> 4845/140084720432896 flags 0 priority 100
>>>> 9 dd=301 locks held 0 write locks 0 pid/thread
>>>> 4845/140084837865216 flags 0 priority 100
>>>> a dd=300 locks held 1 write locks 0 pid/thread
>>>> 4845/140085720139840 flags 10 priority 100
>>>> a READ 1 HELD ipaca/vlv#allcertspkitomcatindex.db
>>>> handle 0
>>>> e dd=299 locks held 1 write locks 0 pid/thread
>>>> 4845/140085720139840 flags 10 priority 100
>>>> e READ 1 HELD ipaca/vlv#allnonrevokedcertspkitomcatindex.db
>>>> handle 0
>>>> 10 dd=298 locks held 1 write locks 0 pid/thread
>>>> 4845/140085720139840 flags 10 priority 100
>>>> 10 READ 1 HELD ipaca/vlv#allrevokedcertspkitomcatindex.db
>>>> handle 0
>>>> 11 dd=297 locks held 1 write locks 0 pid/thread
>>>> 4845/140085720139840 flags 10 priority 100
>>>> 11 READ 1 HELD ipaca/vlv#allrevokedcertsnotafterpkitomcatindex.db
>>>> handle 0
>>>> 14 dd=296 locks held 1 write locks 0 pid/thread
>>>> 4845/140085720139840 flags 10 priority 100
>>>> 14 READ 1 HELD ipaca/vlv#allrevokedorrevokedexpiredcertspkitomcatindex.db
>>>> handle 0
>>>> 15 dd=295 locks held 1 write locks 0 pid/thread
>>>> 4845/140085720139840 flags 10 priority 100
>>>> 15 READ 1 HELD ipaca/vlv#allvalidcertspkitomcatindex.db
>>>> handle 0
>>>> 16 dd=294 locks held 1 write locks 0 pid/thread
>>>> 4845/140085720139840 flags 10 priority 100
>>>> 16 READ 1 HELD ipaca/vlv#allvalidcertsnotafterpkitomcatindex.db
>>>> handle 0
>>>> 17 dd=293 locks held 1 write locks 0 pid/thread
>>>> 4845/140085720139840 flags 10 priority 100
>>>> 17 READ 1 HELD ipaca/vlv#allvalidorrevokedcertspkitomcatindex.db
>>>> handle 0
>>>> 18 dd=292 locks held 1 write locks 0 pid/thread
>>>> 4845/140085720139840 flags 10 priority 100
>>>> 18 READ 1 HELD ipaca/vlv#caallpkitomcatindex.db
>>>> handle 0
>>>> 1d dd=291 locks held 1 write locks 0 pid/thread
>>>> 4845/140085720139840 flags 10 priority 100
>>>> 1d READ 1 HELD ipaca/vlv#cacompletepkitomcatindex.db
>>>> handle 0
>>>> 1e dd=290 locks held 1 write locks 0 pid/thread
>>>> 4845/140085720139840 flags 10 priority 100
>>>> 1e READ 1 HELD ipaca/vlv#cacompleteenrollmentpkitomcatindex.db
>>>> handle 0
>>>> 20 dd=289 locks held 1 write locks 0 pid/thread
>>>> 4845/140085720139840 flags 10 priority 100
>>>> 20 READ 1 HELD ipaca/vlv#cacompleterevocationpkitomcatindex.db
>>>> handle 0
>>>> 21 dd=288 locks held 1 write locks 0 pid/thread
>>>> 4845/140085720139840 flags 10 priority 100
>>>> 21 READ 1 HELD ipaca/vlv#caenrollmentpkitomcatindex.db
>>>> handle 0
>>>> 2b dd=287 locks held 1 write locks 0 pid/thread
>>>> 4845/140085720139840 flags 10 priority 100
>>>> 2b READ 1 HELD ipaca/vlv#carevocationpkitomcatindex.db
>>>> handle 0
>>>> 2c dd=286 locks held 1 write locks 0 pid/thread
>>>> 4845/140085720139840 flags 10 priority 100
>>>> 2c READ 1 HELD changelog/id2entry.db
>>>> handle 0
>>>> 2d dd=285 locks held 0 write locks 0 pid/thread
>>>> 4845/140085719607040 flags 0 priority 100
>>>> 2e dd=284 locks held 1 write locks 0 pid/thread
>>>> 4845/140085720139840 flags 10 priority 100
>>>> 2e READ 1 HELD changelog/entryusn.db
>>>> handle 0
>>>> 2f dd=283 locks held 0 write locks 0 pid/thread
>>>> 4845/140085720139840 flags 0 priority 100
>>>> 30 dd=282 locks held 1 write locks 0 pid/thread
>>>> 4845/140085720139840 flags 10 priority 100
>>>> 30 READ 1 HELD userRoot/entryusn.db
>>>> handle 0
>>>> 31 dd=281 locks held 0 write locks 0 pid/thread
>>>> 4845/140085720139840 flags 0 priority 100
>>>> 32 dd=280 locks held 1 write locks 0 pid/thread
>>>> 4845/140085720139840 flags 10 priority 100
>>>> 32 READ 1 HELD ipaca/entryusn.db
>>>> handle 0
>>>> 33 dd=279 locks held 0 write locks 0 pid/thread
>>>> 4845/140085720139840 flags 0 priority 100
>>>> 34 dd=278 locks held 1 write locks 0 pid/thread
>>>> 4845/140085720139840 flags 10 priority 100
>>>> 34 READ 1 HELD userRoot/entryrdn.db
>>>> handle 0
>>>> 35 dd=277 locks held 0 write locks 0 pid/thread
>>>> 4845/140084544186112 flags 0 priority 100
>>>> 36 dd=276 locks held 0 write locks 0 pid/thread
>>>> 4845/140084636505856 flags 0 priority 100
>>>> 37 dd=275 locks held 0 write locks 0 pid/thread
>>>> 4845/140084854650624 flags 0 priority 100
>>>> 38 dd=274 locks held 1 write locks 0 pid/thread
>>>> 4845/140085720139840 flags 10 priority 100
>>>> 38 READ 1 HELD userRoot/objectclass.db
>>>> handle 0
>>>> 39 dd=273 locks held 0 write locks 0 pid/thread
>>>> 4845/140084569364224 flags 0 priority 100
>>>> 3a dd=272 locks held 1 write locks 0 pid/thread
>>>> 4845/140085720139840 flags 10 priority 100
>>>> 3a READ 1 HELD userRoot/ancestorid.db
>>>> handle 0
>>>> 3b dd=271 locks held 0 write locks 0 pid/thread
>>>> 4845/140084854650624 flags 0 priority 100
>>>> 3c dd=270 locks held 1 write locks 0 pid/thread
>>>> 4845/140085720139840 flags 10 priority 100
>>>> 3c READ 1 HELD changelog/entryrdn.db
>>>> handle 0
>>>> 3d dd=269 locks held 0 write locks 0 pid/thread
>>>> 4845/140085719607040 flags 0 priority 100
>>>> 3e dd=268 locks held 0 write locks 0 pid/thread
>>>> 4845/140084602935040 flags 0 priority 100
>>>> 3f dd=267 locks held 0 write locks 0 pid/thread
>>>> 4845/140085719607040 flags 0 priority 100
>>>> 40 dd=266 locks held 1 write locks 0 pid/thread
>>>> 4845/140085720139840 flags 10 priority 100
>>>> 40 READ 1 HELD changelog/objectclass.db
>>>> handle 0
>>>> 41 dd=265 locks held 0 write locks 0 pid/thread
>>>> 4845/140085719607040 flags 0 priority 100
>>>> 42 dd=264 locks held 0 write locks 0 pid/thread
>>>> 4845/140085719607040 flags 0 priority 100
>>>> 43 dd=263 locks held 0 write locks 0 pid/thread
>>>> 4845/140084653291264 flags 0 priority 100
>>>> 44 dd=262 locks held 1 write locks 0 pid/thread
>>>> 4845/140085720139840 flags 10 priority 100
>>>> 44 READ 1 HELD ipaca/objectclass.db
>>>> handle 0
>>>> 45 dd=261 locks held 0 write locks 0 pid/thread
>>>> 4845/140084577756928 flags 0 priority 100
>>>> 46 dd=260 locks held 0 write locks 0 pid/thread
>>>> 4845/140084720432896 flags 0 priority 100
>>>> 47 dd=259 locks held 1 write locks 0 pid/thread
>>>> 4845/140085720139840 flags 10 priority 100
>>>> 47 READ 1 HELD changelog/aci.db
>>>> handle 0
>>>> 48 dd=258 locks held 0 write locks 0 pid/thread
>>>> 4845/140085720139840 flags 0 priority 100
>>>> 49 dd=257 locks held 1 write locks 0 pid/thread
>>>> 4845/140085720139840 flags 10 priority 100
>>>> 49 READ 1 HELD userRoot/aci.db
>>>> handle 0
>>>> 4a dd=256 locks held 0 write locks 0 pid/thread
>>>> 4845/140085720139840 flags 0 priority 100
>>>> 4b dd=255 locks held 0 write locks 0 pid/thread
>>>> 4845/140084535793408 flags 0 priority 100
>>>> 4c dd=254 locks held 1 write locks 0 pid/thread
>>>> 4845/140085720139840 flags 10 priority 100
>>>> 4c READ 1 HELD ipaca/aci.db
>>>> handle 0
>>>> 4d dd=253 locks held 0 write locks 0 pid/thread
>>>> 4845/140085720139840 flags 0 priority 100
>>>> 4e dd=252 locks held 1 write locks 0 pid/thread
>>>> 4845/140085720139840 flags 10 priority 100
>>>> 4e READ 1 HELD userRoot/parentid.db
>>>> handle 0
>>>> 4f dd=251 locks held 0 write locks 0 pid/thread
>>>> 4845/140085720139840 flags 0 priority 100
>>>> 50 dd=250 locks held 0 write locks 0 pid/thread
>>>> 4845/140085719607040 flags 0 priority 100
>>>> 51 dd=249 locks held 1 write locks 0 pid/thread
>>>> 4845/140085720139840 flags 10 priority 100
>>>> 51 READ 1 HELD changelog/nsuniqueid.db
>>>> handle 0
>>>> 52 dd=248 locks held 1 write locks 0 pid/thread
>>>> 4845/140085720139840 flags 10 priority 100
>>>> 52 READ 1 HELD changelog/changenumber.db
>>>> handle 0
>>>> 53 dd=247 locks held 0 write locks 0 pid/thread
>>>> 4845/140084602935040 flags 0 priority 100
>>>> 54 dd=246 locks held 0 write locks 0 pid/thread
>>>> 4845/140085719607040 flags 0 priority 100
>>>> 55 dd=245 locks held 1 write locks 0 pid/thread
>>>> 4845/140085719607040 flags 10 priority 100
>>>> 55 READ 1 HELD changelog/targetuniqueid.db
>>>> handle 0
>>>> 56 dd=244 locks held 1 write locks 0 pid/thread
>>>> 4845/140085719607040 flags 10 priority 100
>>>> 56 READ 1 HELD changelog/parentid.db
>>>> handle 0
>>>> 57 dd=243 locks held 1 write locks 0 pid/thread
>>>> 4845/140085719607040 flags 10 priority 100
>>>> 57 READ 1 HELD changelog/ancestorid.db
>>>> handle 0
>>>> 58 dd=242 locks held 1 write locks 0 pid/thread
>>>> 4845/140085719607040 flags 10 priority 100
>>>> 58 READ 1 HELD changelog/numsubordinates.db
>>>> handle 0
>>>> 59 dd=241 locks held 0 write locks 0 pid/thread
>>>> 4845/140085719607040 flags 0 priority 100
>>>> 5a dd=240 locks held 0 write locks 0 pid/thread
>>>> 4845/140084544186112 flags 0 priority 100
>>>> 5b dd=239 locks held 1 write locks 0 pid/thread
>>>> 4845/140084577756928 flags 10 priority 100
>>>> 5b READ 1 HELD userRoot/krbPrincipalName.db
>>>> handle 0
>>>> 5c dd=238 locks held 0 write locks 0 pid/thread
>>>> 4845/140084636505856 flags 0 priority 100
>>>> 5d dd=237 locks held 0 write locks 0 pid/thread
>>>> 4845/140084695254784 flags 0 priority 100
>>>> 5e dd=236 locks held 1 write locks 0 pid/thread
>>>> 4845/140084560971520 flags 10 priority 100
>>>> 5e READ 1 HELD userRoot/ipakrbprincipalalias.db
>>>> handle 0
>>>> 5f dd=235 locks held 0 write locks 0 pid/thread
>>>> 4845/140084703647488 flags 0 priority 100
>>>> 60 dd=234 locks held 0 write locks 0 pid/thread
>>>> 4845/140084653291264 flags 0 priority 100
>>>> 61 dd=233 locks held 0 write locks 0 pid/thread
>>>> 4845/140084577756928 flags 0 priority 100
>>>> 62 dd=232 locks held 0 write locks 0 pid/thread
>>>> 4845/140084686862080 flags 0 priority 100
>>>> 63 dd=231 locks held 1 write locks 0 pid/thread
>>>> 4845/140084611327744 flags 10 priority 100
>>>> 63 READ 1 HELD changelog/seeAlso.db
>>>> handle 0
>>>> 64 dd=230 locks held 0 write locks 0 pid/thread
>>>> 4845/140084686862080 flags 0 priority 100
>>>> 65 dd=229 locks held 1 write locks 0 pid/thread
>>>> 4845/140084611327744 flags 10 priority 100
>>>> 65 READ 1 HELD userRoot/seeAlso.db
>>>> handle 0
>>>> 66 dd=228 locks held 0 write locks 0 pid/thread
>>>> 4845/140084636505856 flags 0 priority 100
>>>> 67 dd=227 locks held 1 write locks 0 pid/thread
>>>> 4845/140084611327744 flags 10 priority 100
>>>> 67 READ 1 HELD ipaca/seeAlso.db
>>>> handle 0
>>>> 68 dd=226 locks held 0 write locks 0 pid/thread
>>>> 4845/140084686862080 flags 0 priority 100
>>>> 69 dd=225 locks held 1 write locks 0 pid/thread
>>>> 4845/140084678469376 flags 10 priority 100
>>>> 69 READ 1 HELD ipaca/parentid.db
>>>> handle 0
>>>> 6a dd=224 locks held 0 write locks 0 pid/thread
>>>> 4845/140084678469376 flags 0 priority 100
>>>> 6b dd=223 locks held 0 write locks 0 pid/thread
>>>> 4845/140084829472512 flags 0 priority 100
>>>> 6c dd=222 locks held 0 write locks 0 pid/thread
>>>> 4845/140084653291264 flags 0 priority 100
>>>> 6d dd=221 locks held 0 write locks 0 pid/thread
>>>> 4845/140084569364224 flags 0 priority 100
>>>> 6e dd=220 locks held 0 write locks 0 pid/thread
>>>> 4845/140084636505856 flags 0 priority 100
>>>> 6e READ 1 WAIT userRoot/objectclass.db page
>>>> 18
>>>> 6f dd=219 locks held 0 write locks 0 pid/thread
>>>> 4845/140084544186112 flags 0 priority 100
>>>> 70 dd=218 locks held 0 write locks 0 pid/thread
>>>> 4845/140084569364224 flags 0 priority 100
>>>> 71 dd=217 locks held 0 write locks 0 pid/thread
>>>> 4845/140084619720448 flags 0 priority 100
>>>> 72 dd=216 locks held 0 write locks 0 pid/thread
>>>> 4845/140084552578816 flags 0 priority 100
>>>> 73 dd=215 locks held 0 write locks 0 pid/thread
>>>> 4845/140084829472512 flags 0 priority 100
>>>> 74 dd=214 locks held 0 write locks 0 pid/thread
>>>> 4845/140084628113152 flags 0 priority 100
>>>> 75 dd=213 locks held 0 write locks 0 pid/thread
>>>> 4845/140084686862080 flags 0 priority 100
>>>> 76 dd=212 locks held 1 write locks 0 pid/thread
>>>> 4845/140084560971520 flags 10 priority 100
>>>> 76 READ 1 HELD userRoot/ipauniqueid.db
>>>> handle 0
>>>> 77 dd=211 locks held 0 write locks 0 pid/thread
>>>> 4845/140084661683968 flags 0 priority 100
>>>> 78 dd=210 locks held 0 write locks 0 pid/thread
>>>> 4845/140084846257920 flags 0 priority 100
>>>> 79 dd=209 locks held 0 write locks 0 pid/thread
>>>> 4845/140084628113152 flags 0 priority 100
>>>> 7a dd=208 locks held 1 write locks 0 pid/thread
>>>> 4845/140084560971520 flags 10 priority 100
>>>> 7a READ 1 HELD userRoot/nsuniqueid.db
>>>> handle 0
>>>> 7b dd=207 locks held 1 write locks 0 pid/thread
>>>> 4845/140084560971520 flags 10 priority 100
>>>> 7b READ 1 HELD userRoot/cn.db
>>>> handle 0
>>>> 7c dd=206 locks held 1 write locks 0 pid/thread
>>>> 4845/140084560971520 flags 10 priority 100
>>>> 7c READ 1 HELD userRoot/fqdn.db
>>>> handle 0
>>>> 7d dd=205 locks held 1 write locks 0 pid/thread
>>>> 4845/140084560971520 flags 10 priority 100
>>>> 7d READ 1 HELD userRoot/managedby.db
>>>> handle 0
>>>> 7e dd=204 locks held 1 write locks 0 pid/thread
>>>> 4845/140084560971520 flags 10 priority 100
>>>> 7e READ 1 HELD userRoot/numsubordinates.db
>>>> handle 0
>>>> 7f dd=203 locks held 1 write locks 0 pid/thread
>>>> 4845/140084678469376 flags 10 priority 100
>>>> 7f READ 1 HELD userRoot/member.db
>>>> handle 0
>>>> 80 dd=202 locks held 0 write locks 0 pid/thread
>>>> 4845/140084712040192 flags 0 priority 100
>>>> 81 dd=201 locks held 1 write locks 0 pid/thread
>>>> 4845/140084678469376 flags 10 priority 100
>>>> 81 READ 1 HELD userRoot/memberUser.db
>>>> handle 0
>>>> 82 dd=200 locks held 0 write locks 0 pid/thread
>>>> 4845/140084577756928 flags 0 priority 100
>>>> 83 dd=199 locks held 1 write locks 0 pid/thread
>>>> 4845/140084678469376 flags 10 priority 100
>>>> 83 READ 1 HELD userRoot/memberHost.db
>>>> handle 0
>>>> 84 dd=198 locks held 0 write locks 0 pid/thread
>>>> 4845/140084712040192 flags 0 priority 100
>>>> 85 dd=197 locks held 0 write locks 0 pid/thread
>>>> 4845/140084577756928 flags 0 priority 100
>>>> 86 dd=196 locks held 0 write locks 0 pid/thread
>>>> 4845/140084670076672 flags 0 priority 100
>>>> 87 dd=195 locks held 0 write locks 0 pid/thread
>>>> 4845/140084577756928 flags 0 priority 100
>>>> 88 dd=194 locks held 0 write locks 0 pid/thread
>>>> 4845/140084846257920 flags 0 priority 100
>>>> 89 dd=193 locks held 0 write locks 0 pid/thread
>>>> 4845/140084552578816 flags 0 priority 100
>>>> 8a dd=192 locks held 0 write locks 0 pid/thread
>>>> 4845/140084703647488 flags 0 priority 100
>>>> 8b dd=191 locks held 0 write locks 0 pid/thread
>>>> 4845/140084544186112 flags 0 priority 100
>>>> 8c dd=190 locks held 0 write locks 0 pid/thread
>>>> 4845/140084846257920 flags 0 priority 100
>>>> 8d dd=189 locks held 0 write locks 0 pid/thread
>>>> 4845/140084661683968 flags 0 priority 100
>>>> 8e dd=188 locks held 1 write locks 0 pid/thread
>>>> 4845/140085067675392 flags 10 priority 100
>>>> 8e READ 1 HELD userRoot/macAddress.db
>>>> handle 0
>>>> 8f dd=187 locks held 0 write locks 0 pid/thread
>>>> 4845/140085067675392 flags 0 priority 100
>>>> 90 dd=186 locks held 0 write locks 0 pid/thread
>>>> 4845/140084703647488 flags 0 priority 100
>>>> 91 dd=185 locks held 0 write locks 0 pid/thread
>>>> 4845/140084552578816 flags 0 priority 100
>>>> 92 dd=184 locks held 0 write locks 0 pid/thread
>>>> 4845/140084560971520 flags 0 priority 100
>>>> 92 READ 1 WAIT userRoot/objectclass.db
>>>> page 9
>>>> 93 dd=183 locks held 0 write locks 0 pid/thread
>>>> 4845/140084577756928 flags 0 priority 100
>>>> 94 dd=182 locks held 0 write locks 0 pid/thread
>>>> 4845/140084821079808 flags 0 priority 100
>>>> 94 READ 1 WAIT userRoot/objectclass.db page
>>>> 18
>>>> 95 dd=181 locks held 0 write locks 0 pid/thread
>>>> 4845/140084544186112 flags 0 priority 100
>>>> 96 dd=180 locks held 0 write locks 0 pid/thread
>>>> 4845/140084804294400 flags 0 priority 100
>>>> 97 dd=179 locks held 1 write locks 0 pid/thread
>>>> 4845/140084712040192 flags 10 priority 100
>>>> 97 READ 1 HELD userRoot/uid.db
>>>> handle 0
>>>> 98 dd=178 locks held 0 write locks 0 pid/thread
>>>> 4845/140084552578816 flags 0 priority 100
>>>> 99 dd=177 locks held 0 write locks 0 pid/thread
>>>> 4845/140084577756928 flags 0 priority 100
>>>> 9a dd=176 locks held 0 write locks 0 pid/thread
>>>> 4845/140084602935040 flags 0 priority 100
>>>> 9b dd=175 locks held 1 write locks 0 pid/thread
>>>> 4845/140085076068096 flags 10 priority 100
>>>> 9b READ 1 HELD userRoot/uniquemember.db
>>>> handle 0
>>>> 9c dd=174 locks held 1 write locks 0 pid/thread
>>>> 4845/140085076068096 flags 10 priority 100
>>>> 9c READ 1 HELD userRoot/owner.db
>>>> handle 0
>>>> 9d dd=173 locks held 1 write locks 0 pid/thread
>>>> 4845/140085076068096 flags 10 priority 100
>>>> 9d READ 1 HELD userRoot/ipaallowedtarget.db
>>>> handle 0
>>>> 9e dd=172 locks held 1 write locks 0 pid/thread
>>>> 4845/140085076068096 flags 10 priority 100
>>>> 9e READ 1 HELD userRoot/ipaMemberCertProfile.db
>>>> handle 0
>>>> 9f dd=171 locks held 1 write locks 0 pid/thread
>>>> 4845/140085076068096 flags 10 priority 100
>>>> 9f READ 1 HELD userRoot/ipaassignedidview.db
>>>> handle 0
>>>> a0 dd=170 locks held 1 write locks 0 pid/thread
>>>> 4845/140085076068096 flags 10 priority 100
>>>> a0 READ 1 HELD userRoot/secretary.db
>>>> handle 0
>>>> a1 dd=169 locks held 1 write locks 0 pid/thread
>>>> 4845/140085076068096 flags 10 priority 100
>>>> a1 READ 1 HELD userRoot/memberdenycmd.db
>>>> handle 0
>>>> a2 dd=168 locks held 1 write locks 0 pid/thread
>>>> 4845/140085076068096 flags 10 priority 100
>>>> a2 READ 1 HELD userRoot/memberallowcmd.db
>>>> handle 0
>>>> a3 dd=167 locks held 1 write locks 0 pid/thread
>>>> 4845/140085076068096 flags 10 priority 100
>>>> a3 READ 1 HELD userRoot/manager.db
>>>> handle 0
>>>> a4 dd=166 locks held 1 write locks 0 pid/thread
>>>> 4845/140085076068096 flags 10 priority 100
>>>> a4 READ 1 HELD userRoot/ipasudorunas.db
>>>> handle 0
>>>> a5 dd=165 locks held 1 write locks 0 pid/thread
>>>> 4845/140085076068096 flags 10 priority 100
>>>> a5 READ 1 HELD userRoot/ipaMemberCa.db
>>>> handle 0
>>>> a6 dd=164 locks held 1 write locks 0 pid/thread
>>>> 4845/140085076068096 flags 10 priority 100
>>>> a6 READ 1 HELD userRoot/ipasudorunasgroup.db
>>>> handle 0
>>>> a7 dd=163 locks held 1 write locks 0 pid/thread
>>>> 4845/140085076068096 flags 10 priority 100
>>>> a7 READ 1 HELD userRoot/sourcehost.db
>>>> handle 0
>>>> a8 dd=162 locks held 1 write locks 0 pid/thread
>>>> 4845/140085076068096 flags 10 priority 100
>>>> a8 READ 1 HELD userRoot/memberservice.db
>>>> handle 0
>>>> a9 dd=161 locks held 1 write locks 0 pid/thread
>>>> 4845/140085076068096 flags 10 priority 100
>>>> a9 READ 1 HELD userRoot/ipatokenradiusconfiglink.db
>>>> handle 0
>>>> aa dd=160 locks held 0 write locks 0 pid/thread
>>>> 4845/140084703647488 flags 0 priority 100
>>>> ab dd=159 locks held 0 write locks 0 pid/thread
>>>> 4845/140084821079808 flags 0 priority 100
>>>> ac dd=158 locks held 0 write locks 0 pid/thread
>>>> 4845/140084628113152 flags 0 priority 100
>>>> ad dd=157 locks held 0 write locks 0 pid/thread
>>>> 4845/140084829472512 flags 0 priority 100
>>>> ae dd=156 locks held 0 write locks 0 pid/thread
>>>> 4845/140084829472512 flags 0 priority 100
>>>> af dd=155 locks held 0 write locks 0 pid/thread
>>>> 4845/140084854650624 flags 0 priority 100
>>>> b0 dd=154 locks held 0 write locks 0 pid/thread
>>>> 4845/140084854650624 flags 0 priority 100
>>>> b1 dd=153 locks held 0 write locks 0 pid/thread
>>>> 4845/140084837865216 flags 0 priority 100
>>>> b2 dd=152 locks held 0 write locks 0 pid/thread
>>>> 4845/140084804294400 flags 0 priority 100
>>>> b3 dd=151 locks held 0 write locks 0 pid/thread
>>>> 4845/140084812687104 flags 0 priority 100
>>>> b4 dd=150 locks held 0 write locks 0 pid/thread
>>>> 4845/140084804294400 flags 0 priority 100
>>>> b5 dd=149 locks held 0 write locks 0 pid/thread
>>>> 4845/140084837865216 flags 0 priority 100
>>>> b6 dd=148 locks held 0 write locks 0 pid/thread
>>>> 4845/140084569364224 flags 0 priority 100
>>>> b7 dd=147 locks held 0 write locks 0 pid/thread
>>>> 4845/140084829472512 flags 0 priority 100
>>>> b8 dd=146 locks held 0 write locks 0 pid/thread
>>>> 4845/140084586149632 flags 0 priority 100
>>>> b9 dd=145 locks held 0 write locks 0 pid/thread
>>>> 4845/140084653291264 flags 0 priority 100
>>>> ba dd=144 locks held 0 write locks 0 pid/thread
>>>> 4845/140084636505856 flags 0 priority 100
>>>> bb dd=143 locks held 0 write locks 0 pid/thread
>>>> 4845/140084804294400 flags 0 priority 100
>>>> bc dd=142 locks held 0 write locks 0 pid/thread
>>>> 4845/140084804294400 flags 0 priority 100
>>>> bd dd=141 locks held 0 write locks 0 pid/thread
>>>> 4845/140084695254784 flags 0 priority 100
>>>> be dd=140 locks held 0 write locks 0 pid/thread
>>>> 4845/140084670076672 flags 0 priority 100
>>>> bf dd=139 locks held 0 write locks 0 pid/thread
>>>> 4845/140084628113152 flags 0 priority 100
>>>> c0 dd=138 locks held 0 write locks 0 pid/thread
>>>> 4845/140084661683968 flags 0 priority 100
>>>> c1 dd=137 locks held 0 write locks 0 pid/thread
>>>> 4845/140084712040192 flags 0 priority 100
>>>> c2 dd=136 locks held 0 write locks 0 pid/thread
>>>> 4845/140084661683968 flags 0 priority 100
>>>> c3 dd=135 locks held 0 write locks 0 pid/thread
>>>> 4845/140084577756928 flags 0 priority 100
>>>> c4 dd=134 locks held 0 write locks 0 pid/thread
>>>> 4845/140084854650624 flags 0 priority 100
>>>> c5 dd=133 locks held 1 write locks 0 pid/thread
>>>> 4845/140084644898560 flags 10 priority 100
>>>> c5 READ 1 HELD userRoot/uidnumber.db
>>>> handle 0
>>>> c6 dd=132 locks held 0 write locks 0 pid/thread
>>>> 4845/140084594542336 flags 0 priority 100
>>>> c8 dd=131 locks held 1 write locks 0 pid/thread
>>>> 4845/140084678469376 flags 10 priority 100
>>>> c8 READ 1 HELD ipaca/certstatus.db
>>>> handle 0
>>>> c9 dd=130 locks held 0 write locks 0 pid/thread
>>>> 4845/140084720432896 flags 0 priority 100
>>>> ca dd=129 locks held 0 write locks 0 pid/thread
>>>> 4845/140084619720448 flags 0 priority 100
>>>> cb dd=128 locks held 0 write locks 0 pid/thread
>>>> 4845/140084821079808 flags 0 priority 100
>>>> cc dd=127 locks held 0 write locks 0 pid/thread
>>>> 4845/140084594542336 flags 0 priority 100
>>>> cd dd=126 locks held 0 write locks 0 pid/thread
>>>> 4845/140084560971520 flags 0 priority 100
>>>> ce dd=125 locks held 1 write locks 0 pid/thread
>>>> 4845/140084837865216 flags 10 priority 100
>>>> ce READ 1 HELD userRoot/gidnumber.db
>>>> handle 0
>>>> cf dd=124 locks held 0 write locks 0 pid/thread
>>>> 4845/140084720432896 flags 0 priority 100
>>>> d0 dd=123 locks held 0 write locks 0 pid/thread
>>>> 4845/140084569364224 flags 0 priority 100
>>>> d1 dd=122 locks held 1 write locks 0 pid/thread
>>>> 4845/140084678469376 flags 10 priority 100
>>>> d1 READ 1 HELD userRoot/nscpEntryDN.db
>>>> handle 0
>>>> d2 dd=121 locks held 0 write locks 0 pid/thread
>>>> 4845/140084695254784 flags 0 priority 100
>>>> d3 dd=120 locks held 0 write locks 0 pid/thread
>>>> 4845/140084569364224 flags 0 priority 100
>>>> d4 dd=119 locks held 0 write locks 0 pid/thread
>>>> 4845/140084653291264 flags 0 priority 100
>>>> d5 dd=118 locks held 0 write locks 0 pid/thread
>>>> 4845/140084829472512 flags 0 priority 100
>>>> d6 dd=117 locks held 0 write locks 0 pid/thread
>>>> 4845/140084661683968 flags 0 priority 100
>>>> d7 dd=116 locks held 0 write locks 0 pid/thread
>>>> 4845/140084804294400 flags 0 priority 100
>>>> d8 dd=115 locks held 1 write locks 0 pid/thread
>>>> 4845/140084821079808 flags 10 priority 100
>>>> d8 READ 1 HELD ipaca/description.db
>>>> handle 0
>>>> d9 dd=114 locks held 0 write locks 0 pid/thread
>>>> 4845/140084661683968 flags 0 priority 100
>>>> da dd=113 locks held 0 write locks 0 pid/thread
>>>> 4845/140084837865216 flags 0 priority 100
>>>> db dd=112 locks held 1 write locks 0 pid/thread
>>>> 4845/140084678469376 flags 10 priority 100
>>>> db READ 1 HELD ipaca/cn.db
>>>> handle 0
>>>> dc dd=111 locks held 0 write locks 0 pid/thread
>>>> 4845/140084577756928 flags 0 priority 100
>>>> dd dd=110 locks held 1 write locks 0 pid/thread
>>>> 4845/140084678469376 flags 10 priority 100
>>>> dd READ 1 HELD ipaca/ancestorid.db
>>>> handle 0
>>>> de dd=109 locks held 0 write locks 0 pid/thread
>>>> 4845/140084577756928 flags 0 priority 100
>>>> df dd=108 locks held 0 write locks 0 pid/thread
>>>> 4845/140084703647488 flags 0 priority 100
>>>> e0 dd=107 locks held 0 write locks 0 pid/thread
>>>> 4845/140084569364224 flags 0 priority 100
>>>> e1 dd=106 locks held 0 write locks 0 pid/thread
>>>> 4845/140084569364224 flags 0 priority 100
>>>> e2 dd=105 locks held 0 write locks 0 pid/thread
>>>> 4845/140084821079808 flags 0 priority 100
>>>> e3 dd=104 locks held 1 write locks 0 pid/thread
>>>> 4845/140084686862080 flags 10 priority 100
>>>> e3 READ 1 HELD ipaca/serialno.db
>>>> handle 0
>>>> e4 dd=103 locks held 0 write locks 0 pid/thread
>>>> 4845/140084837865216 flags 0 priority 100
>>>> e5 dd=102 locks held 1 write locks 0 pid/thread
>>>> 4845/140084695254784 flags 10 priority 100
>>>> e5 READ 1 HELD ipaca/revInfo.db
>>>> handle 0
>>>> e6 dd=101 locks held 1 write locks 0 pid/thread
>>>> 4845/140084695254784 flags 10 priority 100
>>>> e6 READ 1 HELD ipaca/revokedby.db
>>>> handle 0
>>>> e7 dd=100 locks held 1 write locks 0 pid/thread
>>>> 4845/140084695254784 flags 10 priority 100
>>>> e7 READ 1 HELD ipaca/revokedOn.db
>>>> handle 0
>>>> e8 dd=99 locks held 0 write locks 0 pid/thread
>>>> 4845/140084829472512 flags 0 priority 100
>>>> e9 dd=98 locks held 0 write locks 0 pid/thread
>>>> 4845/140084846257920 flags 0 priority 100
>>>> ea dd=97 locks held 1 write locks 0 pid/thread
>>>> 4845/140084703647488 flags 10 priority 100
>>>> ea READ 1 HELD ipaca/nsuniqueid.db
>>>> handle 0
>>>> eb dd=96 locks held 1 write locks 0 pid/thread
>>>> 4845/140084703647488 flags 10 priority 100
>>>> eb READ 1 HELD ipaca/requestid.db
>>>> handle 0
>>>> ec dd=95 locks held 1 write locks 0 pid/thread
>>>> 4845/140084703647488 flags 10 priority 100
>>>> ec READ 1 HELD ipaca/requeststate.db
>>>> handle 0
>>>> ed dd=94 locks held 1 write locks 0 pid/thread
>>>> 4845/140084703647488 flags 10 priority 100
>>>> ed READ 1 HELD ipaca/dateOfCreate.db
>>>> handle 0
>>>> ee dd=93 locks held 1 write locks 0 pid/thread
>>>> 4845/140084703647488 flags 10 priority 100
>>>> ee READ 1 HELD ipaca/requesttype.db
>>>> handle 0
>>>> ef dd=92 locks held 1 write locks 0 pid/thread
>>>> 4845/140084703647488 flags 10 priority 100
>>>> ef READ 1 HELD ipaca/numsubordinates.db
>>>> handle 0
>>>> f0 dd=91 locks held 1 write locks 0 pid/thread
>>>> 4845/140084611327744 flags 10 priority 100
>>>> f0 READ 1 HELD userRoot/userCertificate.db
>>>> handle 0
>>>> f1 dd=90 locks held 0 write locks 0 pid/thread
>>>> 4845/140084821079808 flags 0 priority 100
>>>> f2 dd=89 locks held 0 write locks 0 pid/thread
>>>> 4845/140084569364224 flags 0 priority 100
>>>> f3 dd=88 locks held 0 write locks 0 pid/thread
>>>> 4845/140084602935040 flags 0 priority 100
>>>> f4 dd=87 locks held 0 write locks 0 pid/thread
>>>> 4845/140084720432896 flags 0 priority 100
>>>> f5 dd=86 locks held 0 write locks 0 pid/thread
>>>> 4845/140084628113152 flags 0 priority 100
>>>> f6 dd=85 locks held 0 write locks 0 pid/thread
>>>> 4845/140084703647488 flags 0 priority 100
>>>> f7 dd=84 locks held 0 write locks 0 pid/thread
>>>> 4845/140084611327744 flags 0 priority 100
>>>> f8 dd=83 locks held 0 write locks 0 pid/thread
>>>> 4845/140084661683968 flags 0 priority 100
>>>> f9 dd=82 locks held 0 write locks 0 pid/thread
>>>> 4845/140084837865216 flags 0 priority 100
>>>> fa dd=81 locks held 0 write locks 0 pid/thread
>>>> 4845/140084544186112 flags 0 priority 100
>>>> fb dd=80 locks held 0 write locks 0 pid/thread
>>>> 4845/140084703647488 flags 0 priority 100
>>>> fc dd=79 locks held 0 write locks 0 pid/thread
>>>> 4845/140084544186112 flags 0 priority 100
>>>> fd dd=78 locks held 0 write locks 0 pid/thread
>>>> 4845/140084535793408 flags 0 priority 100
>>>> fe dd=77 locks held 0 write locks 0 pid/thread
>>>> 4845/140084586149632 flags 0 priority 100
>>>> ff dd=76 locks held 0 write locks 0 pid/thread
>>>> 4845/140084569364224 flags 0 priority 100
>>>> 100 dd=75 locks held 0 write locks 0 pid/thread
>>>> 4845/140084804294400 flags 0 priority 100
>>>> 101 dd=74 locks held 0 write locks 0 pid/thread
>>>> 4845/140084703647488 flags 0 priority 100
>>>> 102 dd=73 locks held 0 write locks 0 pid/thread
>>>> 4845/140084703647488 flags 0 priority 100
>>>> 103 dd=72 locks held 0 write locks 0 pid/thread
>>>> 4845/140084821079808 flags 0 priority 100
>>>> 104 dd=71 locks held 0 write locks 0 pid/thread
>>>> 4845/140084695254784 flags 0 priority 100
>>>> 105 dd=70 locks held 0 write locks 0 pid/thread
>>>> 4845/140084544186112 flags 0 priority 100
>>>> 106 dd=69 locks held 0 write locks 0 pid/thread
>>>> 4845/140084854650624 flags 0 priority 100
>>>> 107 dd=68 locks held 0 write locks 0 pid/thread
>>>> 4845/140084628113152 flags 0 priority 100
>>>> 108 dd=67 locks held 0 write locks 0 pid/thread
>>>> 4845/140084569364224 flags 0 priority 100
>>>> 109 dd=66 locks held 0 write locks 0 pid/thread
>>>> 4845/140084594542336 flags 0 priority 100
>>>> 10a dd=65 locks held 0 write locks 0 pid/thread
>>>> 4845/140084661683968 flags 0 priority 100
>>>> 10b dd=64 locks held 0 write locks 0 pid/thread
>>>> 4845/140084653291264 flags 0 priority 100
>>>> 10c dd=63 locks held 0 write locks 0 pid/thread
>>>> 4845/140084695254784 flags 0 priority 100
>>>> 10d dd=62 locks held 0 write locks 0 pid/thread
>>>> 4845/140084720432896 flags 0 priority 100
>>>> 10e dd=61 locks held 0 write locks 0 pid/thread
>>>> 4845/140084619720448 flags 0 priority 100
>>>> 10f dd=60 locks held 0 write locks 0 pid/thread
>>>> 4845/140084720432896 flags 0 priority 100
>>>> 110 dd=59 locks held 0 write locks 0 pid/thread
>>>> 4845/140084569364224 flags 0 priority 100
>>>> 111 dd=58 locks held 0 write locks 0 pid/thread
>>>> 4845/140084695254784 flags 0 priority 100
>>>> 112 dd=57 locks held 0 write locks 0 pid/thread
>>>> 4845/140084653291264 flags 0 priority 100
>>>> 113 dd=56 locks held 0 write locks 0 pid/thread
>>>> 4845/140084712040192 flags 0 priority 100
>>>> 114 dd=55 locks held 0 write locks 0 pid/thread
>>>> 4845/140084686862080 flags 0 priority 100
>>>> 115 dd=54 locks held 0 write locks 0 pid/thread
>>>> 4845/140084577756928 flags 0 priority 100
>>>> 115 READ 1 WAIT userRoot/objectclass.db
>>>> page 9
>>>> 116 dd=53 locks held 0 write locks 0 pid/thread
>>>> 4845/140084837865216 flags 0 priority 100
>>>> 116 READ 1 WAIT userRoot/objectclass.db
>>>> page 9
>>>> 117 dd=52 locks held 0 write locks 0 pid/thread
>>>> 4845/140084577756928 flags 0 priority 100
>>>> 118 dd=51 locks held 0 write locks 0 pid/thread
>>>> 4845/140084569364224 flags 0 priority 100
>>>> 119 dd=50 locks held 0 write locks 0 pid/thread
>>>> 4845/140084560971520 flags 0 priority 100
>>>> 11a dd=49 locks held 1 write locks 0 pid/thread
>>>> 4845/140084695254784 flags 10 priority 100
>>>> 11a READ 1 HELD ipaca/metaInfo.db
>>>> handle 0
>>>> 11b dd=48 locks held 1 write locks 0 pid/thread
>>>> 4845/140084695254784 flags 10 priority 100
>>>> 11b READ 1 HELD ipaca/notbefore.db
>>>> handle 0
>>>> 11c dd=47 locks held 1 write locks 0 pid/thread
>>>> 4845/140084695254784 flags 10 priority 100
>>>> 11c READ 1 HELD ipaca/notafter.db
>>>> handle 0
>>>> 11d dd=46 locks held 1 write locks 0 pid/thread
>>>> 4845/140084695254784 flags 10 priority 100
>>>> 11d READ 1 HELD ipaca/duration.db
>>>> handle 0
>>>> 11e dd=45 locks held 1 write locks 0 pid/thread
>>>> 4845/140084695254784 flags 10 priority 100
>>>> 11e READ 1 HELD ipaca/subjectname.db
>>>> handle 0
>>>> 11f dd=44 locks held 1 write locks 0 pid/thread
>>>> 4845/140084695254784 flags 10 priority 100
>>>> 11f READ 1 HELD ipaca/publicKeyData.db
>>>> handle 0
>>>> 120 dd=43 locks held 1 write locks 0 pid/thread
>>>> 4845/140084695254784 flags 10 priority 100
>>>> 120 READ 1 HELD ipaca/extension.db
>>>> handle 0
>>>> 121 dd=42 locks held 1 write locks 0 pid/thread
>>>> 4845/140084695254784 flags 10 priority 100
>>>> 121 READ 1 HELD ipaca/issuedby.db
>>>> handle 0
>>>> 122 dd=41 locks held 0 write locks 0 pid/thread
>>>> 4845/140084712040192 flags 0 priority 100
>>>> 123 dd=40 locks held 0 write locks 0 pid/thread
>>>> 4845/140084812687104 flags 0 priority 100
>>>> 124 dd=39 locks held 0 write locks 0 pid/thread
>>>> 4845/140084544186112 flags 0 priority 100
>>>> 125 dd=38 locks held 0 write locks 0 pid/thread
>>>> 4845/140084686862080 flags 0 priority 100
>>>> 126 dd=37 locks held 0 write locks 0 pid/thread
>>>> 4845/140084552578816 flags 0 priority 100
>>>> 128 dd=36 locks held 0 write locks 0 pid/thread
>>>> 4845/140084686862080 flags 0 priority 100
>>>> 12a dd=35 locks held 0 write locks 0 pid/thread
>>>> 4845/140084720432896 flags 0 priority 100
>>>> 12b dd=34 locks held 0 write locks 0 pid/thread
>>>> 4845/140084552578816 flags 0 priority 100
>>>> 12c dd=33 locks held 0 write locks 0 pid/thread
>>>> 4845/140084670076672 flags 0 priority 100
>>>> 12d dd=32 locks held 0 write locks 0 pid/thread
>>>> 4845/140084577756928 flags 0 priority 100
>>>> 12e dd=31 locks held 0 write locks 0 pid/thread
>>>> 4845/140084712040192 flags 0 priority 100
>>>> 12f dd=30 locks held 0 write locks 0 pid/thread
>>>> 4845/140084670076672 flags 0 priority 100
>>>> 130 dd=29 locks held 0 write locks 0 pid/thread
>>>> 4845/140084577756928 flags 0 priority 100
>>>> 131 dd=28 locks held 0 write locks 0 pid/thread
>>>> 4845/140084560971520 flags 0 priority 100
>>>> 132 dd=27 locks held 0 write locks 0 pid/thread
>>>> 4845/140084670076672 flags 0 priority 100
>>>> 133 dd=26 locks held 0 write locks 0 pid/thread
>>>> 4845/140084602935040 flags 0 priority 100
>>>> 134 dd=25 locks held 0 write locks 0 pid/thread
>>>> 4845/140084552578816 flags 0 priority 100
>>>> 135 dd=24 locks held 0 write locks 0 pid/thread
>>>> 4845/140084678469376 flags 0 priority 100
>>>> 136 dd=23 locks held 0 write locks 0 pid/thread
>>>> 4845/140084544186112 flags 0 priority 100
>>>> 137 dd=22 locks held 0 write locks 0 pid/thread
>>>> 4845/140084577756928 flags 0 priority 100
>>>> 138 dd=21 locks held 0 write locks 0 pid/thread
>>>> 4845/140084703647488 flags 0 priority 100
>>>> 139 dd=20 locks held 0 write locks 0 pid/thread
>>>> 4845/140084678469376 flags 0 priority 100
>>>> 13b dd=19 locks held 0 write locks 0 pid/thread
>>>> 4845/140084812687104 flags 0 priority 100
>>>> 144 dd=18 locks held 0 write locks 0 pid/thread
>>>> 4845/140084670076672 flags 0 priority 100
>>>> 156 dd=17 locks held 0 write locks 0 pid/thread
>>>> 4845/140084594542336 flags 0 priority 100
>>>> 15a dd=16 locks held 0 write locks 0 pid/thread
>>>> 4845/140084577756928 flags 0 priority 100
>>>> 168 dd=15 locks held 0 write locks 0 pid/thread
>>>> 4845/140084653291264 flags 0 priority 100
>>>> 16a dd=14 locks held 0 write locks 0 pid/thread
>>>> 4845/140084829472512 flags 0 priority 100
>>>> 17d dd=13 locks held 0 write locks 0 pid/thread
>>>> 4845/140084829472512 flags 0 priority 100
>>>> 17e dd=12 locks held 0 write locks 0 pid/thread
>>>> 4845/140084829472512 flags 0 priority 100
>>>> 17f dd=11 locks held 0 write locks 0 pid/thread
>>>> 4845/140084586149632 flags 0 priority 100
>>>> 180 dd=10 locks held 0 write locks 0 pid/thread
>>>> 4845/140084594542336 flags 0 priority 100
>>>> 181 dd= 9 locks held 0 write locks 0 pid/thread
>>>> 4845/140084577756928 flags 0 priority 100
>>>> 193 dd= 8 locks held 0 write locks 0 pid/thread
>>>> 4845/140084812687104 flags 0 priority 100
>>>> 196 dd= 7 locks held 0 write locks 0 pid/thread
>>>> 4845/140084695254784 flags 0 priority 100
>>>> 1a1 dd= 6 locks held 0 write locks 0 pid/thread
>>>> 4845/140084720432896 flags 0 priority 100
>>>> 1a2 dd= 5 locks held 0 write locks 0 pid/thread
>>>> 4845/140084577756928 flags 0 priority 100
>>>> 1a3 dd= 4 locks held 0 write locks 0 pid/thread
>>>> 4845/140084812687104 flags 0 priority 100
>>>> 1a4 dd= 3 locks held 0 write locks 0 pid/thread
>>>> 4845/140084812687104 flags 0 priority 100
>>>> 1a5 dd= 2 locks held 0 write locks 0 pid/thread
>>>> 4845/140084577756928 flags 0 priority 100
>>>> 1a6 dd= 1 locks held 0 write locks 0 pid/thread
>>>> 4845/140084594542336 flags 0 priority 100
>>>> 800b3a33 dd= 0 locks held 26 write locks 22 pid/thread
>>>> 4845/140084661683968 flags 0 priority 100
>>>> 800b3a33 WRITE 1 HELD userRoot/objectclass.db
>>>> page 9
>>>> 800b3a33 WRITE 1 HELD userRoot/objectclass.db
>>>> page 8
>>>> 800b3a33 WRITE 1 HELD userRoot/objectclass.db page
>>>> 18
>>>> 800b3a33 WRITE 1 HELD userRoot/objectclass.db
>>>> page 7
>>>> 800b3a33 WRITE 1 HELD userRoot/objectclass.db page
>>>> 14
>>>> 800b3a33 WRITE 1 HELD userRoot/objectclass.db page
>>>> 11
>>>> 800b3a33 WRITE 2 HELD userRoot/objectclass.db
>>>> page 3
>>>> 800b3a33 WRITE 1 HELD userRoot/cn.db page
>>>> 150
>>>> 800b3a33 WRITE 1 HELD userRoot/cn.db page
>>>> 89
>>>> 800b3a33 WRITE 1 HELD userRoot/cn.db page
>>>> 53
>>>> 800b3a33 WRITE 1 HELD userRoot/cn.db page
>>>> 131
>>>> 800b3a33 WRITE 1 HELD userRoot/cn.db page
>>>> 117
>>>> 800b3a33 WRITE 1 HELD userRoot/cn.db page
>>>> 11
>>>> 800b3a33 WRITE 2 HELD userRoot/cn.db page
>>>> 141
>>>> 800b3a33 WRITE 1 HELD userRoot/cn.db page
>>>> 41
>>>> 800b3a33 WRITE 1 HELD userRoot/cn.db page
>>>> 40
>>>> 800b3a33 WRITE 1 HELD userRoot/cn.db page
>>>> 143
>>>> 800b3a33 WRITE 1 HELD userRoot/cn.db page
>>>> 30
>>>> 800b3a33 WRITE 2 HELD userRoot/id2entry.db page
>>>> 8184
>>>> 800b3a33 WRITE 1 HELD userRoot/id2entry.db page
>>>> 8183
>>>> 800b3a33 WRITE 1 HELD userRoot/id2entry.db page
>>>> 7779
>>>> 800b3a33 WRITE 1 HELD userRoot/id2entry.db
>>>> page 0
>>>> 800b3a33 READ 3 HELD userRoot/entryrdn.db
>>>> page 3
>>>> 800b3a33 READ 1 HELD userRoot/entryrdn.db page
>>>> 36
>>>> 800b3a33 READ 1 HELD userRoot/entryrdn.db
>>>> page 4
>>>> 800b3a33 READ 1 HELD userRoot/nsuniqueid.db page
>>>> 86
>>>> =-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
>>>> Locks grouped by object:
>>>> Locker Mode Count Status ----------------- Object
>>>> ---------------
>>>> a4 READ 1 HELD userRoot/ipasudorunas.db
>>>> handle 0
>>>>
>>>> 9e READ 1 HELD userRoot/ipaMemberCertProfile.db
>>>> handle 0
>>>>
>>>> 10 READ 1 HELD ipaca/vlv#allrevokedcertspkitomcatindex.db
>>>> handle 0
>>>>
>>>> 800b3a33 WRITE 2 HELD userRoot/id2entry.db page
>>>> 8184
>>>>
>>>> 800b3a33 WRITE 1 HELD userRoot/id2entry.db page
>>>> 8183
>>>>
>>>> 800b3a33 WRITE 1 HELD userRoot/id2entry.db page
>>>> 7779
>>>>
>>>> a1 READ 1 HELD userRoot/memberdenycmd.db
>>>> handle 0
>>>>
>>>> a READ 1 HELD ipaca/vlv#allcertspkitomcatindex.db
>>>> handle 0
>>>>
>>>> a7 READ 1 HELD userRoot/sourcehost.db
>>>> handle 0
>>>>
>>>> 57 READ 1 HELD changelog/ancestorid.db
>>>> handle 0
>>>>
>>>> e5 READ 1 HELD ipaca/revInfo.db
>>>> handle 0
>>>>
>>>> e6 READ 1 HELD ipaca/revokedby.db
>>>> handle 0
>>>>
>>>> 11 READ 1 HELD ipaca/vlv#allrevokedcertsnotafterpkitomcatindex.db
>>>> handle 0
>>>>
>>>> 4e READ 1 HELD userRoot/parentid.db
>>>> handle 0
>>>>
>>>> 4 READ 1 HELD ipaca/id2entry.db
>>>> handle 0
>>>>
>>>> 58 READ 1 HELD changelog/numsubordinates.db
>>>> handle 0
>>>>
>>>> 67 READ 1 HELD ipaca/seeAlso.db
>>>> handle 0
>>>>
>>>> 2b READ 1 HELD ipaca/vlv#carevocationpkitomcatindex.db
>>>> handle 0
>>>>
>>>> ec READ 1 HELD ipaca/requeststate.db
>>>> handle 0
>>>>
>>>> 11b READ 1 HELD ipaca/notbefore.db
>>>> handle 0
>>>>
>>>> 7e READ 1 HELD userRoot/numsubordinates.db
>>>> handle 0
>>>>
>>>> a2 READ 1 HELD userRoot/memberallowcmd.db
>>>> handle 0
>>>>
>>>> 9c READ 1 HELD userRoot/owner.db
>>>> handle 0
>>>>
>>>> 1e READ 1 HELD ipaca/vlv#cacompleteenrollmentpkitomcatindex.db
>>>> handle 0
>>>>
>>>> 11c READ 1 HELD ipaca/notafter.db
>>>> handle 0
>>>>
>>>> 40 READ 1 HELD changelog/objectclass.db
>>>> handle 0
>>>>
>>>> 2e READ 1 HELD changelog/entryusn.db
>>>> handle 0
>>>>
>>>> 16 READ 1 HELD ipaca/vlv#allvalidcertsnotafterpkitomcatindex.db
>>>> handle 0
>>>>
>>>> 15 READ 1 HELD ipaca/vlv#allvalidcertspkitomcatindex.db
>>>> handle 0
>>>>
>>>> a5 READ 1 HELD userRoot/ipaMemberCa.db
>>>> handle 0
>>>>
>>>> 18 READ 1 HELD ipaca/vlv#caallpkitomcatindex.db
>>>> handle 0
>>>>
>>>> a0 READ 1 HELD userRoot/secretary.db
>>>> handle 0
>>>>
>>>> 81 READ 1 HELD userRoot/memberUser.db
>>>> handle 0
>>>>
>>>> 9f READ 1 HELD userRoot/ipaassignedidview.db
>>>> handle 0
>>>>
>>>> a3 READ 1 HELD userRoot/manager.db
>>>> handle 0
>>>>
>>>> d8 READ 1 HELD ipaca/description.db
>>>> handle 0
>>>>
>>>> a8 READ 1 HELD userRoot/memberservice.db
>>>> handle 0
>>>>
>>>> 44 READ 1 HELD ipaca/objectclass.db
>>>> handle 0
>>>>
>>>> ed READ 1 HELD ipaca/dateOfCreate.db
>>>> handle 0
>>>>
>>>> 800b3a33 WRITE 1 HELD userRoot/id2entry.db
>>>> page 0
>>>>
>>>> 2 READ 1 HELD userRoot/id2entry.db
>>>> handle 0
>>>>
>>>> 5b READ 1 HELD userRoot/krbPrincipalName.db
>>>> handle 0
>>>>
>>>> ee READ 1 HELD ipaca/requesttype.db
>>>> handle 0
>>>>
>>>> c8 READ 1 HELD ipaca/certstatus.db
>>>> handle 0
>>>>
>>>> 56 READ 1 HELD changelog/parentid.db
>>>> handle 0
>>>>
>>>> 83 READ 1 HELD userRoot/memberHost.db
>>>> handle 0
>>>>
>>>> 5e READ 1 HELD userRoot/ipakrbprincipalalias.db
>>>> handle 0
>>>>
>>>> 121 READ 1 HELD ipaca/issuedby.db
>>>> handle 0
>>>>
>>>> 6 READ 1 HELD ipaca/entryrdn.db
>>>> handle 0
>>>>
>>>> e7 READ 1 HELD ipaca/revokedOn.db
>>>> handle 0
>>>>
>>>> 4c READ 1 HELD ipaca/aci.db
>>>> handle 0
>>>>
>>>> 11d READ 1 HELD ipaca/duration.db
>>>> handle 0
>>>>
>>>> 14 READ 1 HELD ipaca/vlv#allrevokedorrevokedexpiredcertspkitomcatindex.db
>>>> handle 0
>>>>
>>>> 21 READ 1 HELD ipaca/vlv#caenrollmentpkitomcatindex.db
>>>> handle 0
>>>>
>>>> 55 READ 1 HELD changelog/targetuniqueid.db
>>>> handle 0
>>>>
>>>> 800b3a33 READ 1 HELD userRoot/entryrdn.db page
>>>> 36
>>>>
>>>> 2c READ 1 HELD changelog/id2entry.db
>>>> handle 0
>>>>
>>>> 800b3a33 READ 1 HELD userRoot/entryrdn.db
>>>> page 4
>>>>
>>>> 34 READ 1 HELD userRoot/entryrdn.db
>>>> handle 0
>>>>
>>>> 800b3a33 READ 3 HELD userRoot/entryrdn.db
>>>> page 3
>>>>
>>>> eb READ 1 HELD ipaca/requestid.db
>>>> handle 0
>>>>
>>>> 49 READ 1 HELD userRoot/aci.db
>>>> handle 0
>>>>
>>>> 76 READ 1 HELD userRoot/ipauniqueid.db
>>>> handle 0
>>>>
>>>> 63 READ 1 HELD changelog/seeAlso.db
>>>> handle 0
>>>>
>>>> 7c READ 1 HELD userRoot/fqdn.db
>>>> handle 0
>>>>
>>>> db READ 1 HELD ipaca/cn.db
>>>> handle 0
>>>>
>>>> ef READ 1 HELD ipaca/numsubordinates.db
>>>> handle 0
>>>>
>>>> 32 READ 1 HELD ipaca/entryusn.db
>>>> handle 0
>>>>
>>>> 1d READ 1 HELD ipaca/vlv#cacompletepkitomcatindex.db
>>>> handle 0
>>>>
>>>> dd READ 1 HELD ipaca/ancestorid.db
>>>> handle 0
>>>>
>>>> a9 READ 1 HELD userRoot/ipatokenradiusconfiglink.db
>>>> handle 0
>>>>
>>>> f0 READ 1 HELD userRoot/userCertificate.db
>>>> handle 0
>>>>
>>>> 11a READ 1 HELD ipaca/metaInfo.db
>>>> handle 0
>>>>
>>>> 7d READ 1 HELD userRoot/managedby.db
>>>> handle 0
>>>>
>>>> ea READ 1 HELD ipaca/nsuniqueid.db
>>>> handle 0
>>>>
>>>> c5 READ 1 HELD userRoot/uidnumber.db
>>>> handle 0
>>>>
>>>> d1 READ 1 HELD userRoot/nscpEntryDN.db
>>>> handle 0
>>>>
>>>> 120 READ 1 HELD ipaca/extension.db
>>>> handle 0
>>>>
>>>> 800b3a33 WRITE 1 HELD userRoot/cn.db page
>>>> 150
>>>>
>>>> 69 READ 1 HELD ipaca/parentid.db
>>>> handle 0
>>>>
>>>> 800b3a33 WRITE 1 HELD userRoot/cn.db page
>>>> 131
>>>>
>>>> 800b3a33 WRITE 1 HELD userRoot/cn.db page
>>>> 143
>>>>
>>>> 800b3a33 WRITE 2 HELD userRoot/cn.db page
>>>> 141
>>>>
>>>> 20 READ 1 HELD ipaca/vlv#cacompleterevocationpkitomcatindex.db
>>>> handle 0
>>>>
>>>> 8e READ 1 HELD userRoot/macAddress.db
>>>> handle 0
>>>>
>>>> e READ 1 HELD ipaca/vlv#allnonrevokedcertspkitomcatindex.db
>>>> handle 0
>>>>
>>>> 17 READ 1 HELD ipaca/vlv#allvalidorrevokedcertspkitomcatindex.db
>>>> handle 0
>>>>
>>>> 800b3a33 WRITE 1 HELD userRoot/cn.db page
>>>> 30
>>>>
>>>> 800b3a33 WRITE 1 HELD userRoot/objectclass.db page
>>>> 14
>>>>
>>>> 800b3a33 WRITE 1 HELD userRoot/objectclass.db
>>>> page 9
>>>> 116 READ 1 WAIT userRoot/objectclass.db
>>>> page 9
>>>> 115 READ 1 WAIT userRoot/objectclass.db
>>>> page 9
>>>> 92 READ 1 WAIT userRoot/objectclass.db
>>>> page 9
>>>>
>>>> 800b3a33 WRITE 1 HELD userRoot/objectclass.db
>>>> page 8
>>>>
>>>> 7b READ 1 HELD userRoot/cn.db
>>>> handle 0
>>>>
>>>> 800b3a33 WRITE 1 HELD userRoot/objectclass.db page
>>>> 11
>>>>
>>>> 800b3a33 WRITE 1 HELD userRoot/objectclass.db
>>>> page 7
>>>>
>>>> 800b3a33 WRITE 1 HELD userRoot/cn.db page
>>>> 11
>>>>
>>>> 38 READ 1 HELD userRoot/objectclass.db
>>>> handle 0
>>>>
>>>> 800b3a33 WRITE 2 HELD userRoot/objectclass.db
>>>> page 3
>>>>
>>>> 800b3a33 WRITE 1 HELD userRoot/cn.db page
>>>> 53
>>>>
>>>> 800b3a33 WRITE 1 HELD userRoot/objectclass.db page
>>>> 18
>>>> 6e READ 1 WAIT userRoot/objectclass.db page
>>>> 18
>>>> 94 READ 1 WAIT userRoot/objectclass.db page
>>>> 18
>>>>
>>>> 800b3a33 WRITE 1 HELD userRoot/cn.db page
>>>> 41
>>>>
>>>> 800b3a33 WRITE 1 HELD userRoot/cn.db page
>>>> 40
>>>>
>>>> 800b3a33 WRITE 1 HELD userRoot/cn.db page
>>>> 89
>>>>
>>>> 800b3a33 WRITE 1 HELD userRoot/cn.db page
>>>> 117
>>>>
>>>> 30 READ 1 HELD userRoot/entryusn.db
>>>> handle 0
>>>>
>>>> 3c READ 1 HELD changelog/entryrdn.db
>>>> handle 0
>>>>
>>>> 97 READ 1 HELD userRoot/uid.db
>>>> handle 0
>>>>
>>>> 47 READ 1 HELD changelog/aci.db
>>>> handle 0
>>>>
>>>> e3 READ 1 HELD ipaca/serialno.db
>>>> handle 0
>>>>
>>>> 7a READ 1 HELD userRoot/nsuniqueid.db
>>>> handle 0
>>>>
>>>> 800b3a33 READ 1 HELD userRoot/nsuniqueid.db page
>>>> 86
>>>>
>>>> 51 READ 1 HELD changelog/nsuniqueid.db
>>>> handle 0
>>>>
>>>> 11e READ 1 HELD ipaca/subjectname.db
>>>> handle 0
>>>>
>>>> 7f READ 1 HELD userRoot/member.db
>>>> handle 0
>>>>
>>>> 11f READ 1 HELD ipaca/publicKeyData.db
>>>> handle 0
>>>>
>>>> 9b READ 1 HELD userRoot/uniquemember.db
>>>> handle 0
>>>>
>>>> 52 READ 1 HELD changelog/changenumber.db
>>>> handle 0
>>>>
>>>> ce READ 1 HELD userRoot/gidnumber.db
>>>> handle 0
>>>>
>>>> 65 READ 1 HELD userRoot/seeAlso.db
>>>> handle 0
>>>>
>>>> 9d READ 1 HELD userRoot/ipaallowedtarget.db
>>>> handle 0
>>>>
>>>> a6 READ 1 HELD userRoot/ipasudorunasgroup.db
>>>> handle 0
>>>>
>>>> 3a READ 1 HELD userRoot/ancestorid.db
>>>> handle 0
>>>>
>>>>
>>>>
>>>>
>>>> pstack output
>>>>
>>>> root at ipa-master ]# pstack 4845
>>>> Thread 44 (Thread 0x7f681dd3a700 (LWP 4847)):
>>>> #0 0x00007f683cd719b3 in select () from /lib64/libc.so.6
>>>> #1 0x00007f683f4fc0e9 in DS_Sleep () from
>>>> /usr/lib64/dirsrv/libslapd.so.0
>>>> #2 0x00007f6832b4a907 in deadlock_threadmain () from
>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>> #3 0x00007f683d6ab7bb in _pt_root () from /lib64/libnspr4.so
>>>> #4 0x00007f683d04cdc5 in start_thread () from /lib64/libpthread.so.0
>>>> #5 0x00007f683cd7a28d in clone () from /lib64/libc.so.6
>>>> Thread 43 (Thread 0x7f681d539700 (LWP 4848)):
>>>> #0 0x00007f683cd719b3 in select () from /lib64/libc.so.6
>>>> #1 0x00007f68376d8bad in __os_yield () from /lib64/libdb-5.3.so
>>>> #2 0x00007f68376d42b3 in __memp_sync_int () from /lib64/libdb-5.3.so
>>>> #3 0x00007f68376e4752 in __txn_checkpoint () from /lib64/libdb-5.3.so
>>>> #4 0x00007f68376e4b74 in __txn_checkpoint_pp () from /lib64/
>>>> libdb-5.3.so
>>>> #5 0x00007f6832b4ea87 in checkpoint_threadmain () from
>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>> #6 0x00007f683d6ab7bb in _pt_root () from /lib64/libnspr4.so
>>>> #7 0x00007f683d04cdc5 in start_thread () from /lib64/libpthread.so.0
>>>> #8 0x00007f683cd7a28d in clone () from /lib64/libc.so.6
>>>> Thread 42 (Thread 0x7f681cd38700 (LWP 4849)):
>>>> #0 0x00007f683cd719b3 in select () from /lib64/libc.so.6
>>>> #1 0x00007f683f4fc0e9 in DS_Sleep () from
>>>> /usr/lib64/dirsrv/libslapd.so.0
>>>> #2 0x00007f6832b4ab7f in trickle_threadmain () from
>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>> #3 0x00007f683d6ab7bb in _pt_root () from /lib64/libnspr4.so
>>>> #4 0x00007f683d04cdc5 in start_thread () from /lib64/libpthread.so.0
>>>> #5 0x00007f683cd7a28d in clone () from /lib64/libc.so.6
>>>> Thread 41 (Thread 0x7f681c537700 (LWP 4850)):
>>>> #0 0x00007f683cd719b3 in select () from /lib64/libc.so.6
>>>> #1 0x00007f683f4fc0e9 in DS_Sleep () from
>>>> /usr/lib64/dirsrv/libslapd.so.0
>>>> #2 0x00007f6832b45707 in perf_threadmain () from
>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>> #3 0x00007f683d6ab7bb in _pt_root () from /lib64/libnspr4.so
>>>> #4 0x00007f683d04cdc5 in start_thread () from /lib64/libpthread.so.0
>>>> #5 0x00007f683cd7a28d in clone () from /lib64/libc.so.6
>>>> Thread 40 (Thread 0x7f681bb2d700 (LWP 4851)):
>>>> #0 0x00007f683d0506d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>> #1 0x00007f683d6a6050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>>> #2 0x00007f683f4eb198 in slapi_wait_condvar () from
>>>> /usr/lib64/dirsrv/libslapd.so.0
>>>> #3 0x00007f683587d62e in cos_cache_wait_on_change () from
>>>> /usr/lib64/dirsrv/plugins/libcos-plugin.so
>>>> #4 0x00007f683d6ab7bb in _pt_root () from /lib64/libnspr4.so
>>>> #5 0x00007f683d04cdc5 in start_thread () from /lib64/libpthread.so.0
>>>> #6 0x00007f683cd7a28d in clone () from /lib64/libc.so.6
>>>> Thread 39 (Thread 0x7f681b32c700 (LWP 4852)):
>>>> #0 0x00007f683d0506d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>> #1 0x00007f683d6a6050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>>> #2 0x00007f683f4eb198 in slapi_wait_condvar () from
>>>> /usr/lib64/dirsrv/libslapd.so.0
>>>> #3 0x00007f68311e8eed in roles_cache_wait_on_change () from
>>>> /usr/lib64/dirsrv/plugins/libroles-plugin.so
>>>> #4 0x00007f683d6ab7bb in _pt_root () from /lib64/libnspr4.so
>>>> #5 0x00007f683d04cdc5 in start_thread () from /lib64/libpthread.so.0
>>>> #6 0x00007f683cd7a28d in clone () from /lib64/libc.so.6
>>>> Thread 38 (Thread 0x7f681ab2b700 (LWP 4853)):
>>>> #0 0x00007f683d0506d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>> #1 0x00007f683d6a6050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>>> #2 0x00007f683f4eb198 in slapi_wait_condvar () from
>>>> /usr/lib64/dirsrv/libslapd.so.0
>>>> #3 0x00007f68311e8eed in roles_cache_wait_on_change () from
>>>> /usr/lib64/dirsrv/plugins/libroles-plugin.so
>>>> #4 0x00007f683d6ab7bb in _pt_root () from /lib64/libnspr4.so
>>>> #5 0x00007f683d04cdc5 in start_thread () from /lib64/libpthread.so.0
>>>> #6 0x00007f683cd7a28d in clone () from /lib64/libc.so.6
>>>> Thread 37 (Thread 0x7f681a32a700 (LWP 4854)):
>>>> #0 0x00007f683d0506d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>> #1 0x00007f683d6a6050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>>> #2 0x00007f683f4eb198 in slapi_wait_condvar () from
>>>> /usr/lib64/dirsrv/libslapd.so.0
>>>> #3 0x00007f68311e8eed in roles_cache_wait_on_change () from
>>>> /usr/lib64/dirsrv/plugins/libroles-plugin.so
>>>> #4 0x00007f683d6ab7bb in _pt_root () from /lib64/libnspr4.so
>>>> #5 0x00007f683d04cdc5 in start_thread () from /lib64/libpthread.so.0
>>>> #6 0x00007f683cd7a28d in clone () from /lib64/libc.so.6
>>>> Thread 36 (Thread 0x7f6819b29700 (LWP 4855)):
>>>> #0 0x00007f683d050a82 in pthread_cond_timedwait@@GLIBC_2.3.2 () from
>>>> /lib64/libpthread.so.0
>>>> #1 0x00007f683d6a5b07 in pt_TimedWait () from /lib64/libnspr4.so
>>>> #2 0x00007f683d6a5fce in PR_WaitCondVar () from /lib64/libnspr4.so
>>>> #3 0x00007f683f9a4d03 in housecleaning ()
>>>> #4 0x00007f683d6ab7bb in _pt_root () from /lib64/libnspr4.so
>>>> #5 0x00007f683d04cdc5 in start_thread () from /lib64/libpthread.so.0
>>>> #6 0x00007f683cd7a28d in clone () from /lib64/libc.so.6
>>>> Thread 35 (Thread 0x7f6819328700 (LWP 4856)):
>>>> #0 0x00007f683d050a82 in pthread_cond_timedwait@@GLIBC_2.3.2 () from
>>>> /lib64/libpthread.so.0
>>>> #1 0x00007f683d6a5b07 in pt_TimedWait () from /lib64/libnspr4.so
>>>> #2 0x00007f683d6a5fce in PR_WaitCondVar () from /lib64/libnspr4.so
>>>> #3 0x00007f683f4911e8 in eq_loop () from /usr/lib64/dirsrv/libslapd.so.
>>>> 0
>>>> #4 0x00007f683d6ab7bb in _pt_root () from /lib64/libnspr4.so
>>>> #5 0x00007f683d04cdc5 in start_thread () from /lib64/libpthread.so.0
>>>> #6 0x00007f683cd7a28d in clone () from /lib64/libc.so.6
>>>> Thread 34 (Thread 0x7f680bfff700 (LWP 4859)):
>>>> #0 0x00007f683d0506d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>> #1 0x00007f683d6a6050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>>> #2 0x00007f683f999fee in connection_wait_for_new_work ()
>>>> #3 0x00007f683f99b719 in connection_threadmain ()
>>>> #4 0x00007f683d6ab7bb in _pt_root () from /lib64/libnspr4.so
>>>> #5 0x00007f683d04cdc5 in start_thread () from /lib64/libpthread.so.0
>>>> #6 0x00007f683cd7a28d in clone () from /lib64/libc.so.6
>>>> Thread 33 (Thread 0x7f680b7fe700 (LWP 4860)):
>>>> #0 0x00007f683d0506d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>> #1 0x00007f683d6a6050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>>> #2 0x00007f683f999fee in connection_wait_for_new_work ()
>>>> #3 0x00007f683f99b719 in connection_threadmain ()
>>>> #4 0x00007f683d6ab7bb in _pt_root () from /lib64/libnspr4.so
>>>> #5 0x00007f683d04cdc5 in start_thread () from /lib64/libpthread.so.0
>>>> #6 0x00007f683cd7a28d in clone () from /lib64/libc.so.6
>>>> Thread 32 (Thread 0x7f680affd700 (LWP 4861)):
>>>> #0 0x00007f683d0506d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>> #1 0x00007f68375ac2f3 in __db_hybrid_mutex_suspend () from /lib64/
>>>> libdb-5.3.so
>>>> #2 0x00007f68375ab640 in __db_tas_mutex_lock () from /lib64/
>>>> libdb-5.3.so
>>>> #3 0x00007f6837655d3a in __lock_get_internal () from /lib64/
>>>> libdb-5.3.so
>>>> #4 0x00007f6837656820 in __lock_get () from /lib64/libdb-5.3.so
>>>> #5 0x00007f6837682142 in __db_lget () from /lib64/libdb-5.3.so
>>>> #6 0x00007f68375c9605 in __bam_search () from /lib64/libdb-5.3.so
>>>> #7 0x00007f68375b4256 in __bamc_search () from /lib64/libdb-5.3.so
>>>> #8 0x00007f68375b5d0f in __bamc_get () from /lib64/libdb-5.3.so
>>>> #9 0x00007f683766eca6 in __dbc_iget () from /lib64/libdb-5.3.so
>>>> #10 0x00007f683767db02 in __dbc_get_pp () from /lib64/libdb-5.3.so
>>>> #11 0x00007f6832b59680 in idl_new_fetch () from
>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>> #12 0x00007f6832b67b26 in index_read_ext_allids () from
>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>> #13 0x00007f6832b52284 in keys2idl () from
>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>> #14 0x00007f6832b529e3 in ava_candidates.isra.0 () from
>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>> #15 0x00007f6832b52fd2 in filter_candidates_ext () from
>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>> #16 0x00007f6832b54096 in list_candidates () from
>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>> #17 0x00007f6832b52f40 in filter_candidates_ext () from
>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>> #18 0x00007f6832b54096 in list_candidates () from
>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>> #19 0x00007f6832b52f40 in filter_candidates_ext () from
>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>> #20 0x00007f6832b54096 in list_candidates () from
>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>> #21 0x00007f6832b52f40 in filter_candidates_ext () from
>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>> #22 0x00007f6832b8e80c in subtree_candidates () from
>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>> #23 0x00007f6832b8fe7f in ldbm_back_search () from
>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>> #24 0x00007f683f4bd1d6 in op_shared_search () from
>>>> /usr/lib64/dirsrv/libslapd.so.0
>>>> #25 0x00007f683f9ae33e in do_search ()
>>>> #26 0x00007f683f99c3c3 in connection_threadmain ()
>>>> #27 0x00007f683d6ab7bb in _pt_root () from /lib64/libnspr4.so
>>>> #28 0x00007f683d04cdc5 in start_thread () from /lib64/libpthread.so.0
>>>> #29 0x00007f683cd7a28d in clone () from /lib64/libc.so.6
>>>> Thread 31 (Thread 0x7f680a7fc700 (LWP 4862)):
>>>> #0 0x00007f683d0506d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>> #1 0x00007f683d6a62c3 in PR_EnterMonitor () from /lib64/libnspr4.so
>>>> #2 0x00007f6832b4d3e6 in dblayer_txn_begin () from
>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>> #3 0x00007f6832b89007 in ldbm_back_modify () from
>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>> #4 0x00007f683f4b6541 in op_shared_modify () from
>>>> /usr/lib64/dirsrv/libslapd.so.0
>>>> #5 0x00007f683f4b7004 in modify_internal_pb () from
>>>> /usr/lib64/dirsrv/libslapd.so.0
>>>> #6 0x00007f683483bbbb in ipalockout_postop () from
>>>> /usr/lib64/dirsrv/plugins/libipa_lockout.so
>>>> #7 0x00007f683f4c8848 in plugin_call_func () from
>>>> /usr/lib64/dirsrv/libslapd.so.0
>>>> #8 0x00007f683f4c8b13 in plugin_call_plugins () from
>>>> /usr/lib64/dirsrv/libslapd.so.0
>>>> #9 0x00007f683f9954d8 in do_bind ()
>>>> #10 0x00007f683f99c3fd in connection_threadmain ()
>>>> #11 0x00007f683d6ab7bb in _pt_root () from /lib64/libnspr4.so
>>>> #12 0x00007f683d04cdc5 in start_thread () from /lib64/libpthread.so.0
>>>> #13 0x00007f683cd7a28d in clone () from /lib64/libc.so.6
>>>> Thread 30 (Thread 0x7f6809ffb700 (LWP 4863)):
>>>> #0 0x00007f683d0506d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>> #1 0x00007f68375ac2f3 in __db_hybrid_mutex_suspend () from /lib64/
>>>> libdb-5.3.so
>>>> #2 0x00007f68375ab640 in __db_tas_mutex_lock () from /lib64/
>>>> libdb-5.3.so
>>>> #3 0x00007f6837655d3a in __lock_get_internal () from /lib64/
>>>> libdb-5.3.so
>>>> #4 0x00007f6837656820 in __lock_get () from /lib64/libdb-5.3.so
>>>> #5 0x00007f6837682142 in __db_lget () from /lib64/libdb-5.3.so
>>>> #6 0x00007f68375c9605 in __bam_search () from /lib64/libdb-5.3.so
>>>> #7 0x00007f68375b4256 in __bamc_search () from /lib64/libdb-5.3.so
>>>> #8 0x00007f68375b5d0f in __bamc_get () from /lib64/libdb-5.3.so
>>>> #9 0x00007f683766eca6 in __dbc_iget () from /lib64/libdb-5.3.so
>>>> #10 0x00007f683767db02 in __dbc_get_pp () from /lib64/libdb-5.3.so
>>>> #11 0x00007f6832b59680 in idl_new_fetch () from
>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>> #12 0x00007f6832b67b26 in index_read_ext_allids () from
>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>> #13 0x00007f6832b52284 in keys2idl () from
>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>> #14 0x00007f6832b529e3 in ava_candidates.isra.0 () from
>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>> #15 0x00007f6832b52fd2 in filter_candidates_ext () from
>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>> #16 0x00007f6832b54096 in list_candidates () from
>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>> #17 0x00007f6832b52f40 in filter_candidates_ext () from
>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>> #18 0x00007f6832b8e80c in subtree_candidates () from
>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>> #19 0x00007f6832b8fe7f in ldbm_back_search () from
>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>> #20 0x00007f683f4bd1d6 in op_shared_search () from
>>>> /usr/lib64/dirsrv/libslapd.so.0
>>>> #21 0x00007f683f4cd94e in search_internal_callback_pb () from
>>>> /usr/lib64/dirsrv/libslapd.so.0
>>>> #22 0x00007f683f4cdbe8 in search_internal_pb () from
>>>> /usr/lib64/dirsrv/libslapd.so.0
>>>> #23 0x00007f683f9ac49b in ids_sasl_canon_user ()
>>>> #24 0x00007f683d46c93b in _sasl_canon_user () from /lib64/libsasl2.so.3
>>>> #25 0x00007f683d46cc4c in _sasl_canon_user_lookup () from
>>>> /lib64/libsasl2.so.3
>>>> #26 0x00007f6837374fb9 in gssapi_server_mech_step () from
>>>> /usr/lib64/sasl2/libgssapiv2.so
>>>> #27 0x00007f683d478b9b in sasl_server_step () from /lib64/libsasl2.so.3
>>>> #28 0x00007f683f9ad83b in ids_sasl_check_bind ()
>>>> #29 0x00007f683f99561a in do_bind ()
>>>> #30 0x00007f683f99c3fd in connection_threadmain ()
>>>> #31 0x00007f683d6ab7bb in _pt_root () from /lib64/libnspr4.so
>>>> #32 0x00007f683d04cdc5 in start_thread () from /lib64/libpthread.so.0
>>>> #33 0x00007f683cd7a28d in clone () from /lib64/libc.so.6
>>>> Thread 29 (Thread 0x7f68097fa700 (LWP 4864)):
>>>> #0 0x00007f683d0506d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>> #1 0x00007f683d6a6050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>>> #2 0x00007f683f999fee in connection_wait_for_new_work ()
>>>> #3 0x00007f683f99b719 in connection_threadmain ()
>>>> #4 0x00007f683d6ab7bb in _pt_root () from /lib64/libnspr4.so
>>>> #5 0x00007f683d04cdc5 in start_thread () from /lib64/libpthread.so.0
>>>> #6 0x00007f683cd7a28d in clone () from /lib64/libc.so.6
>>>> Thread 28 (Thread 0x7f6808ff9700 (LWP 4865)):
>>>> #0 0x00007f683d0506d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>> #1 0x00007f683d6a6050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>>> #2 0x00007f683f999fee in connection_wait_for_new_work ()
>>>> #3 0x00007f683f99b719 in connection_threadmain ()
>>>> #4 0x00007f683d6ab7bb in _pt_root () from /lib64/libnspr4.so
>>>> #5 0x00007f683d04cdc5 in start_thread () from /lib64/libpthread.so.0
>>>> #6 0x00007f683cd7a28d in clone () from /lib64/libc.so.6
>>>> Thread 27 (Thread 0x7f6803fff700 (LWP 4866)):
>>>> #0 0x00007f683d0506d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>> #1 0x00007f683d6a6050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>>> #2 0x00007f683f999fee in connection_wait_for_new_work ()
>>>> #3 0x00007f683f99b719 in connection_threadmain ()
>>>> #4 0x00007f683d6ab7bb in _pt_root () from /lib64/libnspr4.so
>>>> #5 0x00007f683d04cdc5 in start_thread () from /lib64/libpthread.so.0
>>>> #6 0x00007f683cd7a28d in clone () from /lib64/libc.so.6
>>>> Thread 26 (Thread 0x7f68037fe700 (LWP 4867)):
>>>> #0 0x00007f683d0506d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>> #1 0x00007f683d6a6050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>>> #2 0x00007f683f999fee in connection_wait_for_new_work ()
>>>> #3 0x00007f683f99b719 in connection_threadmain ()
>>>> #4 0x00007f683d6ab7bb in _pt_root () from /lib64/libnspr4.so
>>>> #5 0x00007f683d04cdc5 in start_thread () from /lib64/libpthread.so.0
>>>> #6 0x00007f683cd7a28d in clone () from /lib64/libc.so.6
>>>> Thread 25 (Thread 0x7f6802ffd700 (LWP 4868)):
>>>> #0 0x00007f683d0506d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>> #1 0x00007f683d6a6050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>>> #2 0x00007f683f999fee in connection_wait_for_new_work ()
>>>> #3 0x00007f683f99b719 in connection_threadmain ()
>>>> #4 0x00007f683d6ab7bb in _pt_root () from /lib64/libnspr4.so
>>>> #5 0x00007f683d04cdc5 in start_thread () from /lib64/libpthread.so.0
>>>> #6 0x00007f683cd7a28d in clone () from /lib64/libc.so.6
>>>> Thread 24 (Thread 0x7f68027fc700 (LWP 4869)):
>>>> #0 0x00007f683d0506d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>> #1 0x00007f68375ac2f3 in __db_hybrid_mutex_suspend () from /lib64/
>>>> libdb-5.3.so
>>>> #2 0x00007f68375abb37 in __db_tas_mutex_readlock () from /lib64/
>>>> libdb-5.3.so
>>>> #3 0x00007f68376c5d35 in __memp_fget () from /lib64/libdb-5.3.so
>>>> #4 0x00007f683766f333 in __dbc_iget () from /lib64/libdb-5.3.so
>>>> #5 0x00007f683767db02 in __dbc_get_pp () from /lib64/libdb-5.3.so
>>>> #6 0x00007f6832b59822 in idl_new_fetch () from
>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>> #7 0x00007f6832b67b26 in index_read_ext_allids () from
>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>> #8 0x00007f6832b52284 in keys2idl () from
>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>> #9 0x00007f6832b529e3 in ava_candidates.isra.0 () from
>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>> #10 0x00007f6832b52fd2 in filter_candidates_ext () from
>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>> #11 0x00007f6832b54096 in list_candidates () from
>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>> #12 0x00007f6832b52f40 in filter_candidates_ext () from
>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>> #13 0x00007f6832b54096 in list_candidates () from
>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>> #14 0x00007f6832b52f40 in filter_candidates_ext () from
>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>> #15 0x00007f6832b54096 in list_candidates () from
>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>> #16 0x00007f6832b52f40 in filter_candidates_ext () from
>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>> #17 0x00007f6832b8e80c in subtree_candidates () from
>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>> #18 0x00007f6832b8fe7f in ldbm_back_search () from
>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>> #19 0x00007f683f4bd1d6 in op_shared_search () from
>>>> /usr/lib64/dirsrv/libslapd.so.0
>>>> #20 0x00007f683f9ae33e in do_search ()
>>>> #21 0x00007f683f99c3c3 in connection_threadmain ()
>>>> #22 0x00007f683d6ab7bb in _pt_root () from /lib64/libnspr4.so
>>>> #23 0x00007f683d04cdc5 in start_thread () from /lib64/libpthread.so.0
>>>> #24 0x00007f683cd7a28d in clone () from /lib64/libc.so.6
>>>> Thread 23 (Thread 0x7f6801ffb700 (LWP 4870)):
>>>> #0 0x00007f683d0506d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>> #1 0x00007f683d6a6050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>>> #2 0x00007f683f999fee in connection_wait_for_new_work ()
>>>> #3 0x00007f683f99b719 in connection_threadmain ()
>>>> #4 0x00007f683d6ab7bb in _pt_root () from /lib64/libnspr4.so
>>>> #5 0x00007f683d04cdc5 in start_thread () from /lib64/libpthread.so.0
>>>> #6 0x00007f683cd7a28d in clone () from /lib64/libc.so.6
>>>> Thread 22 (Thread 0x7f68017fa700 (LWP 4871)):
>>>> #0 0x00007f683d0506d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>> #1 0x00007f683d6a6050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>>> #2 0x00007f683f999fee in connection_wait_for_new_work ()
>>>> #3 0x00007f683f99b719 in connection_threadmain ()
>>>> #4 0x00007f683d6ab7bb in _pt_root () from /lib64/libnspr4.so
>>>> #5 0x00007f683d04cdc5 in start_thread () from /lib64/libpthread.so.0
>>>> #6 0x00007f683cd7a28d in clone () from /lib64/libc.so.6
>>>> Thread 21 (Thread 0x7f6800ff9700 (LWP 4872)):
>>>> #0 0x00007f683d0506d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>> #1 0x00007f683d6a6050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>>> #2 0x00007f683f999fee in connection_wait_for_new_work ()
>>>> #3 0x00007f683f99b719 in connection_threadmain ()
>>>> #4 0x00007f683d6ab7bb in _pt_root () from /lib64/libnspr4.so
>>>> #5 0x00007f683d04cdc5 in start_thread () from /lib64/libpthread.so.0
>>>> #6 0x00007f683cd7a28d in clone () from /lib64/libc.so.6
>>>> Thread 20 (Thread 0x7f68007f8700 (LWP 4873)):
>>>> #0 0x00007f683d0506d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>> #1 0x00007f68375ac2f3 in __db_hybrid_mutex_suspend () from /lib64/
>>>> libdb-5.3.so
>>>> #2 0x00007f68375ab640 in __db_tas_mutex_lock () from /lib64/
>>>> libdb-5.3.so
>>>> #3 0x00007f68376c5e1b in __memp_fget () from /lib64/libdb-5.3.so
>>>> #4 0x00007f68375c9211 in __bam_search () from /lib64/libdb-5.3.so
>>>> #5 0x00007f68375b4256 in __bamc_search () from /lib64/libdb-5.3.so
>>>> #6 0x00007f68375b86c4 in __bamc_put () from /lib64/libdb-5.3.so
>>>> #7 0x00007f683766f6d5 in __dbc_iput () from /lib64/libdb-5.3.so
>>>> #8 0x00007f683766aa0e in __db_put () from /lib64/libdb-5.3.so
>>>> #9 0x00007f683767ffa4 in __db_put_pp () from /lib64/libdb-5.3.so
>>>> #10 0x00007f6832b5a4cf in idl_new_insert_key () from
>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>> #11 0x00007f6832b695b5 in addordel_values_sv.isra.3 () from
>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>> #12 0x00007f6832b6a25a in index_addordel_values_ext_sv () from
>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>> #13 0x00007f6832b6a694 in index_addordel_values_sv () from
>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>> #14 0x00007f6832b6a75a in index_addordel_entry () from
>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>> #15 0x00007f6832b6d5fa in ldbm_back_add () from
>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>> #16 0x00007f683f46fcca in op_shared_add () from
>>>> /usr/lib64/dirsrv/libslapd.so.0
>>>> #17 0x00007f683f471020 in do_add () from /usr/lib64/dirsrv/libslapd.so.
>>>> 0
>>>> #18 0x00007f683f99c303 in connection_threadmain ()
>>>> #19 0x00007f683d6ab7bb in _pt_root () from /lib64/libnspr4.so
>>>> #20 0x00007f683d04cdc5 in start_thread () from /lib64/libpthread.so.0
>>>> #21 0x00007f683cd7a28d in clone () from /lib64/libc.so.6
>>>> Thread 19 (Thread 0x7f67ffff7700 (LWP 4874)):
>>>> #0 0x00007f683d0506d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>> #1 0x00007f683d6a62c3 in PR_EnterMonitor () from /lib64/libnspr4.so
>>>> #2 0x00007f6832b4d3e6 in dblayer_txn_begin () from
>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>> #3 0x00007f6832b89007 in ldbm_back_modify () from
>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>> #4 0x00007f683f4b6541 in op_shared_modify () from
>>>> /usr/lib64/dirsrv/libslapd.so.0
>>>> #5 0x00007f683f4b7004 in modify_internal_pb () from
>>>> /usr/lib64/dirsrv/libslapd.so.0
>>>> #6 0x00007f6832dd3b60 in ipapwd_apply_mods () from
>>>> /usr/lib64/dirsrv/plugins/libipa_pwd_extop.so
>>>> #7 0x00007f6832dd78e0 in store_new_keys () from
>>>> /usr/lib64/dirsrv/plugins/libipa_pwd_extop.so
>>>> #8 0x00007f6832dd9ad0 in ipapwd_extop () from
>>>> /usr/lib64/dirsrv/plugins/libipa_pwd_extop.so
>>>> #9 0x00007f683f4c6ba2 in plugin_call_exop_plugins () from
>>>> /usr/lib64/dirsrv/libslapd.so.0
>>>> #10 0x00007f683f9a2efe in do_extended ()
>>>> #11 0x00007f683f99c41a in connection_threadmain ()
>>>> #12 0x00007f683d6ab7bb in _pt_root () from /lib64/libnspr4.so
>>>> #13 0x00007f683d04cdc5 in start_thread () from /lib64/libpthread.so.0
>>>> #14 0x00007f683cd7a28d in clone () from /lib64/libc.so.6
>>>> Thread 18 (Thread 0x7f67ff7f6700 (LWP 4875)):
>>>> #0 0x00007f683d0506d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>> #1 0x00007f683d6a6050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>>> #2 0x00007f683f999fee in connection_wait_for_new_work ()
>>>> #3 0x00007f683f99b719 in connection_threadmain ()
>>>> #4 0x00007f683d6ab7bb in _pt_root () from /lib64/libnspr4.so
>>>> #5 0x00007f683d04cdc5 in start_thread () from /lib64/libpthread.so.0
>>>> #6 0x00007f683cd7a28d in clone () from /lib64/libc.so.6
>>>> Thread 17 (Thread 0x7f67feff5700 (LWP 4876)):
>>>> #0 0x00007f683d0506d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>> #1 0x00007f68375ac2f3 in __db_hybrid_mutex_suspend () from /lib64/
>>>> libdb-5.3.so
>>>> #2 0x00007f68375ab640 in __db_tas_mutex_lock () from /lib64/
>>>> libdb-5.3.so
>>>> #3 0x00007f6837655d3a in __lock_get_internal () from /lib64/
>>>> libdb-5.3.so
>>>> #4 0x00007f6837656820 in __lock_get () from /lib64/libdb-5.3.so
>>>> #5 0x00007f6837682142 in __db_lget () from /lib64/libdb-5.3.so
>>>> #6 0x00007f68375c9605 in __bam_search () from /lib64/libdb-5.3.so
>>>> #7 0x00007f68375b4256 in __bamc_search () from /lib64/libdb-5.3.so
>>>> #8 0x00007f68375b5d0f in __bamc_get () from /lib64/libdb-5.3.so
>>>> #9 0x00007f683766eca6 in __dbc_iget () from /lib64/libdb-5.3.so
>>>> #10 0x00007f683767db02 in __dbc_get_pp () from /lib64/libdb-5.3.so
>>>> #11 0x00007f6832b59680 in idl_new_fetch () from
>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>> #12 0x00007f6832b67b26 in index_read_ext_allids () from
>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>> #13 0x00007f6832b52284 in keys2idl () from
>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>> #14 0x00007f6832b529e3 in ava_candidates.isra.0 () from
>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>> #15 0x00007f6832b52fd2 in filter_candidates_ext () from
>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>> #16 0x00007f6832b54096 in list_candidates () from
>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>> #17 0x00007f6832b52f40 in filter_candidates_ext () from
>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>> #18 0x00007f6832b8e80c in subtree_candidates () from
>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>> #19 0x00007f6832b8fe7f in ldbm_back_search () from
>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>> #20 0x00007f683f4bd1d6 in op_shared_search () from
>>>> /usr/lib64/dirsrv/libslapd.so.0
>>>> #21 0x00007f683f4cd94e in search_internal_callback_pb () from
>>>> /usr/lib64/dirsrv/libslapd.so.0
>>>> #22 0x00007f683f4cdbe8 in search_internal_pb () from
>>>> /usr/lib64/dirsrv/libslapd.so.0
>>>> #23 0x00007f6832dd75dc in get_entry_by_principal () from
>>>> /usr/lib64/dirsrv/plugins/libipa_pwd_extop.so
>>>> #24 0x00007f6832dd8eb1 in ipapwd_extop () from
>>>> /usr/lib64/dirsrv/plugins/libipa_pwd_extop.so
>>>> #25 0x00007f683f4c6ba2 in plugin_call_exop_plugins () from
>>>> /usr/lib64/dirsrv/libslapd.so.0
>>>> #26 0x00007f683f9a2efe in do_extended ()
>>>> #27 0x00007f683f99c41a in connection_threadmain ()
>>>> #28 0x00007f683d6ab7bb in _pt_root () from /lib64/libnspr4.so
>>>> #29 0x00007f683d04cdc5 in start_thread () from /lib64/libpthread.so.0
>>>> #30 0x00007f683cd7a28d in clone () from /lib64/libc.so.6
>>>> Thread 16 (Thread 0x7f67fe7f4700 (LWP 4877)):
>>>> #0 0x00007f683d0506d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>> #1 0x00007f683d6a6050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>>> #2 0x00007f683f999fee in connection_wait_for_new_work ()
>>>> #3 0x00007f683f99b719 in connection_threadmain ()
>>>> #4 0x00007f683d6ab7bb in _pt_root () from /lib64/libnspr4.so
>>>> #5 0x00007f683d04cdc5 in start_thread () from /lib64/libpthread.so.0
>>>> #6 0x00007f683cd7a28d in clone () from /lib64/libc.so.6
>>>> Thread 15 (Thread 0x7f67fdff3700 (LWP 4878)):
>>>> #0 0x00007f683d0506d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>> #1 0x00007f683d6a6050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>>> #2 0x00007f683f999fee in connection_wait_for_new_work ()
>>>> #3 0x00007f683f99b719 in connection_threadmain ()
>>>> #4 0x00007f683d6ab7bb in _pt_root () from /lib64/libnspr4.so
>>>> #5 0x00007f683d04cdc5 in start_thread () from /lib64/libpthread.so.0
>>>> #6 0x00007f683cd7a28d in clone () from /lib64/libc.so.6
>>>> Thread 14 (Thread 0x7f67fd7f2700 (LWP 4879)):
>>>> #0 0x00007f683d0506d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>> #1 0x00007f683d6a6050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>>> #2 0x00007f683f999fee in connection_wait_for_new_work ()
>>>> #3 0x00007f683f99b719 in connection_threadmain ()
>>>> #4 0x00007f683d6ab7bb in _pt_root () from /lib64/libnspr4.so
>>>> #5 0x00007f683d04cdc5 in start_thread () from /lib64/libpthread.so.0
>>>> #6 0x00007f683cd7a28d in clone () from /lib64/libc.so.6
>>>> Thread 13 (Thread 0x7f67fcff1700 (LWP 4880)):
>>>> #0 0x00007f683d0506d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>> #1 0x00007f683d6a6050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>>> #2 0x00007f683f999fee in connection_wait_for_new_work ()
>>>> #3 0x00007f683f99b719 in connection_threadmain ()
>>>> #4 0x00007f683d6ab7bb in _pt_root () from /lib64/libnspr4.so
>>>> #5 0x00007f683d04cdc5 in start_thread () from /lib64/libpthread.so.0
>>>> #6 0x00007f683cd7a28d in clone () from /lib64/libc.so.6
>>>> Thread 12 (Thread 0x7f67fc7f0700 (LWP 4881)):
>>>> #0 0x00007f683d0506d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>> #1 0x00007f683d6a6050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>>> #2 0x00007f683f999fee in connection_wait_for_new_work ()
>>>> #3 0x00007f683f99b719 in connection_threadmain ()
>>>> #4 0x00007f683d6ab7bb in _pt_root () from /lib64/libnspr4.so
>>>> #5 0x00007f683d04cdc5 in start_thread () from /lib64/libpthread.so.0
>>>> #6 0x00007f683cd7a28d in clone () from /lib64/libc.so.6
>>>> Thread 11 (Thread 0x7f67fbfef700 (LWP 4882)):
>>>> #0 0x00007f683d0506d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>> #1 0x00007f683d6a6050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>>> #2 0x00007f683f999fee in connection_wait_for_new_work ()
>>>> #3 0x00007f683f99b719 in connection_threadmain ()
>>>> #4 0x00007f683d6ab7bb in _pt_root () from /lib64/libnspr4.so
>>>> #5 0x00007f683d04cdc5 in start_thread () from /lib64/libpthread.so.0
>>>> #6 0x00007f683cd7a28d in clone () from /lib64/libc.so.6
>>>> Thread 10 (Thread 0x7f67fb7ee700 (LWP 4883)):
>>>> #0 0x00007f683d0506d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>> #1 0x00007f68375ac2f3 in __db_hybrid_mutex_suspend () from /lib64/
>>>> libdb-5.3.so
>>>> #2 0x00007f68375ab640 in __db_tas_mutex_lock () from /lib64/
>>>> libdb-5.3.so
>>>> #3 0x00007f6837655d3a in __lock_get_internal () from /lib64/
>>>> libdb-5.3.so
>>>> #4 0x00007f6837656820 in __lock_get () from /lib64/libdb-5.3.so
>>>> #5 0x00007f6837682142 in __db_lget () from /lib64/libdb-5.3.so
>>>> #6 0x00007f68375c9605 in __bam_search () from /lib64/libdb-5.3.so
>>>> #7 0x00007f68375b4256 in __bamc_search () from /lib64/libdb-5.3.so
>>>> #8 0x00007f68375b5d0f in __bamc_get () from /lib64/libdb-5.3.so
>>>> #9 0x00007f683766eca6 in __dbc_iget () from /lib64/libdb-5.3.so
>>>> #10 0x00007f683767db02 in __dbc_get_pp () from /lib64/libdb-5.3.so
>>>> #11 0x00007f6832b59680 in idl_new_fetch () from
>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>> #12 0x00007f6832b67b26 in index_read_ext_allids () from
>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>> #13 0x00007f6832b52284 in keys2idl () from
>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>> #14 0x00007f6832b529e3 in ava_candidates.isra.0 () from
>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>> #15 0x00007f6832b52fd2 in filter_candidates_ext () from
>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>> #16 0x00007f6832b54096 in list_candidates () from
>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>> #17 0x00007f6832b52f40 in filter_candidates_ext () from
>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>> #18 0x00007f6832b54096 in list_candidates () from
>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>> #19 0x00007f6832b52f40 in filter_candidates_ext () from
>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>> #20 0x00007f6832b54096 in list_candidates () from
>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>> #21 0x00007f6832b52f40 in filter_candidates_ext () from
>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>> #22 0x00007f6832b8e80c in subtree_candidates () from
>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>> #23 0x00007f6832b8fe7f in ldbm_back_search () from
>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>> #24 0x00007f683f4bd1d6 in op_shared_search () from
>>>> /usr/lib64/dirsrv/libslapd.so.0
>>>> #25 0x00007f683f9ae33e in do_search ()
>>>> #26 0x00007f683f99c3c3 in connection_threadmain ()
>>>> #27 0x00007f683d6ab7bb in _pt_root () from /lib64/libnspr4.so
>>>> #28 0x00007f683d04cdc5 in start_thread () from /lib64/libpthread.so.0
>>>> #29 0x00007f683cd7a28d in clone () from /lib64/libc.so.6
>>>> Thread 9 (Thread 0x7f67fafed700 (LWP 4884)):
>>>> #0 0x00007f683d0506d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>> #1 0x00007f683d6a6050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>>> #2 0x00007f683f999fee in connection_wait_for_new_work ()
>>>> #3 0x00007f683f99b719 in connection_threadmain ()
>>>> #4 0x00007f683d6ab7bb in _pt_root () from /lib64/libnspr4.so
>>>> #5 0x00007f683d04cdc5 in start_thread () from /lib64/libpthread.so.0
>>>> #6 0x00007f683cd7a28d in clone () from /lib64/libc.so.6
>>>> Thread 8 (Thread 0x7f67fa7ec700 (LWP 4885)):
>>>> #0 0x00007f683d0506d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>> #1 0x00007f68375ac2f3 in __db_hybrid_mutex_suspend () from /lib64/
>>>> libdb-5.3.so
>>>> #2 0x00007f68375ab640 in __db_tas_mutex_lock () from /lib64/
>>>> libdb-5.3.so
>>>> #3 0x00007f6837655d3a in __lock_get_internal () from /lib64/
>>>> libdb-5.3.so
>>>> #4 0x00007f6837656820 in __lock_get () from /lib64/libdb-5.3.so
>>>> #5 0x00007f6837682142 in __db_lget () from /lib64/libdb-5.3.so
>>>> #6 0x00007f68375c9605 in __bam_search () from /lib64/libdb-5.3.so
>>>> #7 0x00007f68375b4256 in __bamc_search () from /lib64/libdb-5.3.so
>>>> #8 0x00007f68375b5d0f in __bamc_get () from /lib64/libdb-5.3.so
>>>> #9 0x00007f683766eca6 in __dbc_iget () from /lib64/libdb-5.3.so
>>>> #10 0x00007f683767db02 in __dbc_get_pp () from /lib64/libdb-5.3.so
>>>> #11 0x00007f6832b59680 in idl_new_fetch () from
>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>> #12 0x00007f6832b67b26 in index_read_ext_allids () from
>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>> #13 0x00007f6832b52284 in keys2idl () from
>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>> #14 0x00007f6832b529e3 in ava_candidates.isra.0 () from
>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>> #15 0x00007f6832b52fd2 in filter_candidates_ext () from
>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>> #16 0x00007f6832b54096 in list_candidates () from
>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>> #17 0x00007f6832b52f40 in filter_candidates_ext () from
>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>> #18 0x00007f6832b54096 in list_candidates () from
>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>> #19 0x00007f6832b52f40 in filter_candidates_ext () from
>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>> #20 0x00007f6832b54096 in list_candidates () from
>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>> #21 0x00007f6832b52f40 in filter_candidates_ext () from
>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>> #22 0x00007f6832b8e80c in subtree_candidates () from
>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>> #23 0x00007f6832b8fe7f in ldbm_back_search () from
>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>> #24 0x00007f683f4bd1d6 in op_shared_search () from
>>>> /usr/lib64/dirsrv/libslapd.so.0
>>>> #25 0x00007f683f9ae33e in do_search ()
>>>> #26 0x00007f683f99c3c3 in connection_threadmain ()
>>>> #27 0x00007f683d6ab7bb in _pt_root () from /lib64/libnspr4.so
>>>> #28 0x00007f683d04cdc5 in start_thread () from /lib64/libpthread.so.0
>>>> #29 0x00007f683cd7a28d in clone () from /lib64/libc.so.6
>>>> Thread 7 (Thread 0x7f67f9feb700 (LWP 4886)):
>>>> #0 0x00007f683d0506d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>> #1 0x00007f683d6a6050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>>> #2 0x00007f683f999fee in connection_wait_for_new_work ()
>>>> #3 0x00007f683f99b719 in connection_threadmain ()
>>>> #4 0x00007f683d6ab7bb in _pt_root () from /lib64/libnspr4.so
>>>> #5 0x00007f683d04cdc5 in start_thread () from /lib64/libpthread.so.0
>>>> #6 0x00007f683cd7a28d in clone () from /lib64/libc.so.6
>>>> Thread 6 (Thread 0x7f67f97ea700 (LWP 4887)):
>>>> #0 0x00007f683d0506d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>> #1 0x00007f683d6a6050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>>> #2 0x00007f683f999fee in connection_wait_for_new_work ()
>>>> #3 0x00007f683f99b719 in connection_threadmain ()
>>>> #4 0x00007f683d6ab7bb in _pt_root () from /lib64/libnspr4.so
>>>> #5 0x00007f683d04cdc5 in start_thread () from /lib64/libpthread.so.0
>>>> #6 0x00007f683cd7a28d in clone () from /lib64/libc.so.6
>>>> Thread 5 (Thread 0x7f67f8fe9700 (LWP 4888)):
>>>> #0 0x00007f683d0506d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>> #1 0x00007f683d6a6050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>>> #2 0x00007f683f999fee in connection_wait_for_new_work ()
>>>> #3 0x00007f683f99b719 in connection_threadmain ()
>>>> #4 0x00007f683d6ab7bb in _pt_root () from /lib64/libnspr4.so
>>>> #5 0x00007f683d04cdc5 in start_thread () from /lib64/libpthread.so.0
>>>> #6 0x00007f683cd7a28d in clone () from /lib64/libc.so.6
>>>> Thread 4 (Thread 0x7f67f87e8700 (LWP 4889)):
>>>> #0 0x00007f683cd719b3 in select () from /lib64/libc.so.6
>>>> #1 0x00007f683f4fc0e9 in DS_Sleep () from
>>>> /usr/lib64/dirsrv/libslapd.so.0
>>>> #2 0x00007f683f99d325 in time_thread ()
>>>> #3 0x00007f683d6ab7bb in _pt_root () from /lib64/libnspr4.so
>>>> #4 0x00007f683d04cdc5 in start_thread () from /lib64/libpthread.so.0
>>>> #5 0x00007f683cd7a28d in clone () from /lib64/libc.so.6
>>>> Thread 3 (Thread 0x7f67f7de6700 (LWP 4892)):
>>>> #0 0x00007f683d0506d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>> #1 0x00007f683d6a6050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>>> #2 0x00007f683f9a8f25 in ps_send_results ()
>>>> #3 0x00007f683d6ab7bb in _pt_root () from /lib64/libnspr4.so
>>>> #4 0x00007f683d04cdc5 in start_thread () from /lib64/libpthread.so.0
>>>> #5 0x00007f683cd7a28d in clone () from /lib64/libc.so.6
>>>> Thread 2 (Thread 0x7f67f75e5700 (LWP 5084)):
>>>> #0 0x00007f683d0506d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>> #1 0x00007f683d6a6050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>>> #2 0x00007f683f9a8f25 in ps_send_results ()
>>>> #3 0x00007f683d6ab7bb in _pt_root () from /lib64/libnspr4.so
>>>> #4 0x00007f683d04cdc5 in start_thread () from /lib64/libpthread.so.0
>>>> #5 0x00007f683cd7a28d in clone () from /lib64/libc.so.6
>>>> Thread 1 (Thread 0x7f683f964840 (LWP 4845)):
>>>> #0 0x00007f683d0506d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>> #1 0x00007f683d6a62c3 in PR_EnterMonitor () from /lib64/libnspr4.so
>>>> #2 0x00007f683f99d5ed in setup_pr_read_pds ()
>>>> #3 0x00007f683f9a0fd9 in slapd_daemon ()
>>>> #4 0x00007f683f992c6c in main ()
>>>>
>>>>
>>>>
>>>> the top output seems ok, there was just a sudden spike to around 340%
>>>> cpu then it comes down
>>>>
>>>> top - 08:53:12 up 6 days, 23:20, 1 user, load average: 0.00, 0.01,
>>>> 0.12
>>>> Threads: 44 total, 0 running, 44 sleeping, 0 stopped, 0 zombie
>>>> %Cpu(s): 0.0 us, 0.0 sy, 0.0 ni,100.0 id, 0.0 wa, 0.0 hi, 0.0
>>>> si, 0.0 st
>>>> KiB Mem : 65533176 total, 52165676 free, 6135088 used, 7232412
>>>> buff/cache
>>>> KiB Swap: 3999996 total, 3999996 free, 0 used. 58452040 avail
>>>> Mem
>>>>
>>>> PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+
>>>> COMMAND
>>>> 4845 dirsrv 20 0 5133196 3.150g 281272 S 0.0 5.0 31:34.51
>>>> ns-slapd
>>>> 4847 dirsrv 20 0 5133196 3.150g 281272 S 0.0 5.0 0:13.53
>>>> ns-slapd
>>>> 4848 dirsrv 20 0 5133196 3.150g 281272 S 0.0 5.0 0:13.16
>>>> ns-slapd
>>>> 4849 dirsrv 20 0 5133196 3.150g 281272 S 0.0 5.0 0:45.27
>>>> ns-slapd
>>>> 4850 dirsrv 20 0 5133196 3.150g 281272 S 0.0 5.0 0:01.60
>>>> ns-slapd
>>>> 4851 dirsrv 20 0 5133196 3.150g 281272 S 0.0 5.0 0:00.00
>>>> ns-slapd
>>>> 4852 dirsrv 20 0 5133196 3.150g 281272 S 0.0 5.0 0:00.00
>>>> ns-slapd
>>>> 4853 dirsrv 20 0 5133196 3.150g 281272 S 0.0 5.0 0:00.00
>>>> ns-slapd
>>>> 4854 dirsrv 20 0 5133196 3.150g 281272 S 0.0 5.0 0:00.00
>>>> ns-slapd
>>>> 4855 dirsrv 20 0 5133196 3.150g 281272 S 0.0 5.0 0:03.02
>>>> ns-slapd
>>>> 4856 dirsrv 20 0 5133196 3.150g 281272 S 0.0 5.0 0:00.26
>>>> ns-slapd
>>>> 4859 dirsrv 20 0 5133196 3.150g 281272 S 0.0 5.0 3:18.67
>>>> ns-slapd
>>>> 4860 dirsrv 20 0 5133196 3.150g 281272 S 0.0 5.0 3:19.82
>>>> ns-slapd
>>>> 4861 dirsrv 20 0 5133196 3.150g 281272 S 0.0 5.0 3:20.23
>>>> ns-slapd
>>>> 4862 dirsrv 20 0 5133196 3.150g 281272 S 0.0 5.0 3:22.65
>>>> ns-slapd
>>>> 4863 dirsrv 20 0 5133196 3.150g 281272 S 0.0 5.0 3:16.64
>>>> ns-slapd
>>>> 4864 dirsrv 20 0 5133196 3.150g 281272 S 0.0 5.0 3:17.39
>>>> ns-slapd
>>>> 4865 dirsrv 20 0 5133196 3.150g 281272 S 0.0 5.0 3:17.80
>>>> ns-slapd
>>>>
>>>>
>>>> Thanks
>>>> Rakesh
>>>>
>>>> On Tue, Sep 6, 2016 at 12:09 AM, Rakesh Rajasekharan <
>>>> <rakesh.rajasekharan at gmail.com>rakesh.rajasekharan at gmail.com> wrote:
>>>>
>>>>> Hi Thierry/Ludwig,
>>>>>
>>>>> Unfortunately I had by then restarted the service and since then have
>>>>> been trying to hit the hang issue again but no luck this time
>>>>>
>>>>> It has been running fine for the last few hours now in-spite of trying
>>>>> all that I believe could cause the hang like making simultaneous client
>>>>> addition requests.
>>>>>
>>>>> I will continue testing this and next time I get it I will make sure I
>>>>> get the pstack and also get the dump of db lock info.
>>>>>
>>>>> Thanks,
>>>>> Rakesh
>>>>>
>>>>>
>>>>>
>>>>> On Mon, Sep 5, 2016 at 6:14 PM, Ludwig Krispenz <
>>>>> <lkrispen at redhat.com>lkrispen at redhat.com> wrote:
>>>>>
>>>>>>
>>>>>> On 09/05/2016 02:31 PM, thierry bordaz wrote:
>>>>>>
>>>>>> Hi Rakesh,
>>>>>>
>>>>>> Thanks you soooo much for you continuous help on this !!
>>>>>>
>>>>>> If the hang is still going on, would you dump the DB lock information
>>>>>> with:
>>>>>>
>>>>>> db_stat -CA -N -h /var/lib/dirsrv/slapd-<instance>/db
>>>>>> >/tmp/db_lock_info
>>>>>>
>>>>>> It is looking like several threads are waiting for one/several db
>>>>>> locks. With the lock info we will know which thread acquired it/them.
>>>>>> A guess is that it could be the checkpointing thread but this one is
>>>>>> also waiting (on a memory pool).
>>>>>>
>>>>>> I am copying Ludwig on this thread in case this pstack rings any bell.
>>>>>>
>>>>>> the frequent presence of __db_tas_mutex_lock() looks like the NUMA
>>>>>> problem of libdb, although the threads already have stopped spinning (maybe
>>>>>> this was an effect of gcore).
>>>>>> If the hang aoccurs again, could you check cpu consumption
>>>>>> top -H -p <slapd-pid>
>>>>>> and get a pstack
>>>>>> pstack <slapd-pid>
>>>>>>
>>>>>>
>>>>>> best regards
>>>>>> thierry
>>>>>>
>>>>>> On 09/05/2016 02:05 PM, Rakesh Rajasekharan wrote:
>>>>>>
>>>>>> Hi Thierry,
>>>>>>
>>>>>> I was able to now reporduce the issue..
>>>>>>
>>>>>> the ns-slapd process just got hung,.. however, no core file was
>>>>>> generate..
>>>>>>
>>>>>> I manually created a coredump using gcore and then took a strace of it
>>>>>> this is strace from the coredump generated
>>>>>>
>>>>>> GNU gdb (GDB) Red Hat Enterprise Linux 7.6.1-80.el7
>>>>>> Copyright (C) 2013 Free Software Foundation, Inc.
>>>>>> License GPLv3+: GNU GPL version 3 or later <
>>>>>> <http://gnu.org/licenses/gpl.h>http://gnu.org/licenses/gpl.html>
>>>>>> This is free software: you are free to change and redistribute it.
>>>>>> There is NO WARRANTY, to the extent permitted by law. Type "show
>>>>>> copying"
>>>>>> and "show warranty" for details.
>>>>>> This GDB was configured as "x86_64-redhat-linux-gnu".
>>>>>> For bug reporting instructions, please see:
>>>>>> < <http://www.gnu.org/software/g>http://www.gnu.org/software/g
>>>>>> db/bugs/>...
>>>>>> Reading symbols from /usr/sbin/ns-slapd...Reading symbols from
>>>>>> /usr/sbin/ns-slapd...(no debugging symbols found)...done.
>>>>>> (no debugging symbols found)...done.
>>>>>> [New LWP 105159]
>>>>>> [New LWP 105160]
>>>>>> [New LWP 105161]
>>>>>> [New LWP 105162]
>>>>>> [New LWP 105163]
>>>>>> [New LWP 105164]
>>>>>> [New LWP 105165]
>>>>>> [New LWP 105166]
>>>>>> [New LWP 105167]
>>>>>> [New LWP 105168]
>>>>>> [New LWP 105171]
>>>>>> [New LWP 105172]
>>>>>> [New LWP 105173]
>>>>>> [New LWP 105174]
>>>>>> [New LWP 105175]
>>>>>> [New LWP 105176]
>>>>>> [New LWP 105177]
>>>>>> [New LWP 105178]
>>>>>> [New LWP 105179]
>>>>>> [New LWP 105180]
>>>>>> [New LWP 105181]
>>>>>> [New LWP 105182]
>>>>>> [New LWP 105183]
>>>>>> [New LWP 105184]
>>>>>> [New LWP 105185]
>>>>>> [New LWP 105186]
>>>>>> [New LWP 105187]
>>>>>> [New LWP 105188]
>>>>>> [New LWP 105189]
>>>>>> [New LWP 105190]
>>>>>> [New LWP 105191]
>>>>>> [New LWP 105192]
>>>>>> [New LWP 105193]
>>>>>> [New LWP 105194]
>>>>>> [New LWP 105195]
>>>>>> [New LWP 105196]
>>>>>> [New LWP 105197]
>>>>>> [New LWP 105198]
>>>>>> [New LWP 105199]
>>>>>> [New LWP 105200]
>>>>>> [New LWP 105201]
>>>>>> [New LWP 105203]
>>>>>> [New LWP 105215]
>>>>>> [New LWP 105158]
>>>>>> [Thread debugging using libthread_db enabled]
>>>>>> Using host libthread_db library "/lib64/libthread_db.so.1".
>>>>>> Core was generated by `/usr/sbin/ns-slapd'.
>>>>>> #0 0x00007f1b48ae69b3 in select () from /lib64/libc.so.6
>>>>>>
>>>>>> Thread 44 (Thread 0x7f1b4b6d9840 (LWP 105158)):
>>>>>> #0 0x00007f1b48dc56d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>>>> No symbol table info available.
>>>>>> #1 0x00007f1b4941b2c3 in PR_EnterMonitor () from /lib64/libnspr4.so
>>>>>> No symbol table info available.
>>>>>> #2 0x00007f1b4b7125ed in setup_pr_read_pds ()
>>>>>> No symbol table info available.
>>>>>> #3 0x00007f1b4b715fd9 in slapd_daemon ()
>>>>>> No symbol table info available.
>>>>>> #4 0x00007f1b4b707c6c in main ()
>>>>>> No symbol table info available.
>>>>>>
>>>>>> Thread 43 (Thread 0x7f1a5df0f700 (LWP 105215)):
>>>>>> #0 0x00007f1b48dc56d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>>>> No symbol table info available.
>>>>>> #1 0x00007f1b4941b050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>>>>> No symbol table info available.
>>>>>> #2 0x00007f1b4b71df25 in ps_send_results ()
>>>>>> No symbol table info available.
>>>>>> #3 0x00007f1b494207bb in _pt_root () from /lib64/libnspr4.so
>>>>>> No symbol table info available.
>>>>>> #4 0x00007f1b48dc1dc5 in start_thread () from /lib64/libpthread.so.0
>>>>>> No symbol table info available.
>>>>>> #5 0x00007f1b48aef28d in clone () from /lib64/libc.so.6
>>>>>> No symbol table info available.
>>>>>>
>>>>>> Thread 42 (Thread 0x7f1b03fe7700 (LWP 105203)):
>>>>>> #0 0x00007f1b48dc56d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>>>> No symbol table info available.
>>>>>> #1 0x00007f1b4941b050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>>>>> No symbol table info available.
>>>>>> #2 0x00007f1b4b71df25 in ps_send_results ()
>>>>>> No symbol table info available.
>>>>>> #3 0x00007f1b494207bb in _pt_root () from /lib64/libnspr4.so
>>>>>> No symbol table info available.
>>>>>> #4 0x00007f1b48dc1dc5 in start_thread () from /lib64/libpthread.so.0
>>>>>> No symbol table info available.
>>>>>> #5 0x00007f1b48aef28d in clone () from /lib64/libc.so.6
>>>>>> No symbol table info available.
>>>>>>
>>>>>> Thread 41 (Thread 0x7f1b047e8700 (LWP 105201)):
>>>>>> #0 0x00007f1b48ae69b3 in select () from /lib64/libc.so.6
>>>>>> No symbol table info available.
>>>>>> #1 0x00007f1b4b2710e9 in DS_Sleep () from
>>>>>> /usr/lib64/dirsrv/libslapd.so.0
>>>>>> No symbol table info available.
>>>>>> #2 0x00007f1b4b712325 in time_thread ()
>>>>>> No symbol table info available.
>>>>>> #3 0x00007f1b494207bb in _pt_root () from /lib64/libnspr4.so
>>>>>> No symbol table info available.
>>>>>> #4 0x00007f1b48dc1dc5 in start_thread () from /lib64/libpthread.so.0
>>>>>> No symbol table info available.
>>>>>> #5 0x00007f1b48aef28d in clone () from /lib64/libc.so.6
>>>>>> No symbol table info available.
>>>>>>
>>>>>> Thread 40 (Thread 0x7f1b04fe9700 (LWP 105200)):
>>>>>> #0 0x00007f1b48dc56d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>>>> No symbol table info available.
>>>>>> #1 0x00007f1b433212f3 in __db_hybrid_mutex_suspend () from /lib64/
>>>>>> libdb-5.3.so
>>>>>> No symbol table info available.
>>>>>> #2 0x00007f1b43320640 in __db_tas_mutex_lock () from /lib64/
>>>>>> libdb-5.3.so
>>>>>> No symbol table info available.
>>>>>> #3 0x00007f1b4343ae1b in __memp_fget () from /lib64/libdb-5.3.so
>>>>>> No symbol table info available.
>>>>>> #4 0x00007f1b4333e211 in __bam_search () from /lib64/libdb-5.3.so
>>>>>> No symbol table info available.
>>>>>> #5 0x00007f1b43329256 in __bamc_search () from /lib64/libdb-5.3.so
>>>>>> No symbol table info available.
>>>>>> #6 0x00007f1b4332d6c4 in __bamc_put () from /lib64/libdb-5.3.so
>>>>>> No symbol table info available.
>>>>>> #7 0x00007f1b433e46d5 in __dbc_iput () from /lib64/libdb-5.3.so
>>>>>> No symbol table info available.
>>>>>> #8 0x00007f1b433dfa0e in __db_put () from /lib64/libdb-5.3.so
>>>>>> No symbol table info available.
>>>>>> #9 0x00007f1b433f4fa4 in __db_put_pp () from /lib64/libdb-5.3.so
>>>>>> No symbol table info available.
>>>>>> #10 0x00007f1b3e8cf4cf in idl_new_insert_key () from
>>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>>> No symbol table info available.
>>>>>> #11 0x00007f1b3e8de5b5 in addordel_values_sv.isra.3 () from
>>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>>> No symbol table info available.
>>>>>> #12 0x00007f1b3e8df25a in index_addordel_values_ext_sv () from
>>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>>> No symbol table info available.
>>>>>> #13 0x00007f1b3e8df694 in index_addordel_values_sv () from
>>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>>> No symbol table info available.
>>>>>> #14 0x00007f1b3e8df75a in index_addordel_entry () from
>>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>>> No symbol table info available.
>>>>>> #15 0x00007f1b3e8e25fa in ldbm_back_add () from
>>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>>> No symbol table info available.
>>>>>> #16 0x00007f1b4b1e4cca in op_shared_add () from
>>>>>> /usr/lib64/dirsrv/libslapd.so.0
>>>>>> No symbol table info available.
>>>>>> #17 0x00007f1b4b1e6020 in do_add () from
>>>>>> /usr/lib64/dirsrv/libslapd.so.0
>>>>>> No symbol table info available.
>>>>>> #18 0x00007f1b4b711303 in connection_threadmain ()
>>>>>> No symbol table info available.
>>>>>> #19 0x00007f1b494207bb in _pt_root () from /lib64/libnspr4.so
>>>>>> No symbol table info available.
>>>>>> #20 0x00007f1b48dc1dc5 in start_thread () from /lib64/libpthread.so.0
>>>>>> No symbol table info available.
>>>>>> #21 0x00007f1b48aef28d in clone () from /lib64/libc.so.6
>>>>>> No symbol table info available.
>>>>>>
>>>>>> Thread 39 (Thread 0x7f1b057ea700 (LWP 105199)):
>>>>>> #0 0x00007f1b48dc56d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>>>> No symbol table info available.
>>>>>> #1 0x00007f1b4941b050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>>>>> No symbol table info available.
>>>>>> #2 0x00007f1b4b70efee in connection_wait_for_new_work ()
>>>>>> No symbol table info available.
>>>>>> #3 0x00007f1b4b710719 in connection_threadmain ()
>>>>>> No symbol table info available.
>>>>>> #4 0x00007f1b494207bb in _pt_root () from /lib64/libnspr4.so
>>>>>> No symbol table info available.
>>>>>> #5 0x00007f1b48dc1dc5 in start_thread () from /lib64/libpthread.so.0
>>>>>> No symbol table info available.
>>>>>> #6 0x00007f1b48aef28d in clone () from /lib64/libc.so.6
>>>>>> No symbol table info available.
>>>>>>
>>>>>> Thread 38 (Thread 0x7f1b05feb700 (LWP 105198)):
>>>>>> #0 0x00007f1b48dc56d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>>>> No symbol table info available.
>>>>>> #1 0x00007f1b4941b050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>>>>> No symbol table info available.
>>>>>> #2 0x00007f1b4b70efee in connection_wait_for_new_work ()
>>>>>> No symbol table info available.
>>>>>> #3 0x00007f1b4b710719 in connection_threadmain ()
>>>>>> No symbol table info available.
>>>>>> #4 0x00007f1b494207bb in _pt_root () from /lib64/libnspr4.so
>>>>>> No symbol table info available.
>>>>>> #5 0x00007f1b48dc1dc5 in start_thread () from /lib64/libpthread.so.0
>>>>>> No symbol table info available.
>>>>>> #6 0x00007f1b48aef28d in clone () from /lib64/libc.so.6
>>>>>> No symbol table info available.
>>>>>>
>>>>>> Thread 37 (Thread 0x7f1b067ec700 (LWP 105197)):
>>>>>> #0 0x00007f1b48dc56d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>>>> No symbol table info available.
>>>>>> #1 0x00007f1b4941b050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>>>>> No symbol table info available.
>>>>>> #2 0x00007f1b4b70efee in connection_wait_for_new_work ()
>>>>>> No symbol table info available.
>>>>>> #3 0x00007f1b4b710719 in connection_threadmain ()
>>>>>> No symbol table info available.
>>>>>> #4 0x00007f1b494207bb in _pt_root () from /lib64/libnspr4.so
>>>>>> No symbol table info available.
>>>>>> #5 0x00007f1b48dc1dc5 in start_thread () from /lib64/libpthread.so.0
>>>>>> No symbol table info available.
>>>>>> #6 0x00007f1b48aef28d in clone () from /lib64/libc.so.6
>>>>>> No symbol table info available.
>>>>>>
>>>>>> Thread 36 (Thread 0x7f1b06fed700 (LWP 105196)):
>>>>>> #0 0x00007f1b48dc56d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>>>> No symbol table info available.
>>>>>> #1 0x00007f1b4941b050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>>>>> No symbol table info available.
>>>>>> #2 0x00007f1b4b70efee in connection_wait_for_new_work ()
>>>>>> No symbol table info available.
>>>>>> #3 0x00007f1b4b710719 in connection_threadmain ()
>>>>>> No symbol table info available.
>>>>>> #4 0x00007f1b494207bb in _pt_root () from /lib64/libnspr4.so
>>>>>> No symbol table info available.
>>>>>> #5 0x00007f1b48dc1dc5 in start_thread () from /lib64/libpthread.so.0
>>>>>> No symbol table info available.
>>>>>> #6 0x00007f1b48aef28d in clone () from /lib64/libc.so.6
>>>>>> No symbol table info available.
>>>>>>
>>>>>> Thread 35 (Thread 0x7f1b077ee700 (LWP 105195)):
>>>>>> #0 0x00007f1b48dc56d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>>>> No symbol table info available.
>>>>>> #1 0x00007f1b4941b2c3 in PR_EnterMonitor () from /lib64/libnspr4.so
>>>>>> No symbol table info available.
>>>>>> #2 0x00007f1b3e8c23e6 in dblayer_txn_begin () from
>>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>>> No symbol table info available.
>>>>>> #3 0x00007f1b3e8fe007 in ldbm_back_modify () from
>>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>>> No symbol table info available.
>>>>>> #4 0x00007f1b4b22b541 in op_shared_modify () from
>>>>>> /usr/lib64/dirsrv/libslapd.so.0
>>>>>> No symbol table info available.
>>>>>> #5 0x00007f1b4b22c004 in modify_internal_pb () from
>>>>>> /usr/lib64/dirsrv/libslapd.so.0
>>>>>> No symbol table info available.
>>>>>> #6 0x00007f1b3eb48b60 in ipapwd_apply_mods () from
>>>>>> /usr/lib64/dirsrv/plugins/libipa_pwd_extop.so
>>>>>> No symbol table info available.
>>>>>> #7 0x00007f1b3eb4c8e0 in store_new_keys () from
>>>>>> /usr/lib64/dirsrv/plugins/libipa_pwd_extop.so
>>>>>> No symbol table info available.
>>>>>> #8 0x00007f1b3eb4ead0 in ipapwd_extop () from
>>>>>> /usr/lib64/dirsrv/plugins/libipa_pwd_extop.so
>>>>>> No symbol table info available.
>>>>>> #9 0x00007f1b4b23bba2 in plugin_call_exop_plugins () from
>>>>>> /usr/lib64/dirsrv/libslapd.so.0
>>>>>> No symbol table info available.
>>>>>> #10 0x00007f1b4b717efe in do_extended ()
>>>>>> No symbol table info available.
>>>>>> #11 0x00007f1b4b71141a in connection_threadmain ()
>>>>>> No symbol table info available.
>>>>>> #12 0x00007f1b494207bb in _pt_root () from /lib64/libnspr4.so
>>>>>> No symbol table info available.
>>>>>> #13 0x00007f1b48dc1dc5 in start_thread () from /lib64/libpthread.so.0
>>>>>> No symbol table info available.
>>>>>> #14 0x00007f1b48aef28d in clone () from /lib64/libc.so.6
>>>>>> No symbol table info available.
>>>>>>
>>>>>> Thread 34 (Thread 0x7f1b07fef700 (LWP 105194)):
>>>>>> #0 0x00007f1b48dc56d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>>>> No symbol table info available.
>>>>>> #1 0x00007f1b4941b050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>>>>> No symbol table info available.
>>>>>> #2 0x00007f1b4b70efee in connection_wait_for_new_work ()
>>>>>> No symbol table info available.
>>>>>> #3 0x00007f1b4b710719 in connection_threadmain ()
>>>>>> No symbol table info available.
>>>>>> #4 0x00007f1b494207bb in _pt_root () from /lib64/libnspr4.so
>>>>>> No symbol table info available.
>>>>>> #5 0x00007f1b48dc1dc5 in start_thread () from /lib64/libpthread.so.0
>>>>>> No symbol table info available.
>>>>>> #6 0x00007f1b48aef28d in clone () from /lib64/libc.so.6
>>>>>> No symbol table info available.
>>>>>>
>>>>>> Thread 33 (Thread 0x7f1b087f0700 (LWP 105193)):
>>>>>> #0 0x00007f1b48dc56d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>>>> No symbol table info available.
>>>>>> #1 0x00007f1b4941b050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>>>>> No symbol table info available.
>>>>>> #2 0x00007f1b4b70efee in connection_wait_for_new_work ()
>>>>>> No symbol table info available.
>>>>>> #3 0x00007f1b4b710719 in connection_threadmain ()
>>>>>> No symbol table info available.
>>>>>> #4 0x00007f1b494207bb in _pt_root () from /lib64/libnspr4.so
>>>>>> No symbol table info available.
>>>>>> #5 0x00007f1b48dc1dc5 in start_thread () from /lib64/libpthread.so.0
>>>>>> No symbol table info available.
>>>>>> #6 0x00007f1b48aef28d in clone () from /lib64/libc.so.6
>>>>>> No symbol table info available.
>>>>>>
>>>>>> Thread 32 (Thread 0x7f1b08ff1700 (LWP 105192)):
>>>>>> #0 0x00007f1b48dc56d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>>>> No symbol table info available.
>>>>>> #1 0x00007f1b4941b050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>>>>> No symbol table info available.
>>>>>> #2 0x00007f1b4b70efee in connection_wait_for_new_work ()
>>>>>> No symbol table info available.
>>>>>> #3 0x00007f1b4b710719 in connection_threadmain ()
>>>>>> No symbol table info available.
>>>>>> #4 0x00007f1b494207bb in _pt_root () from /lib64/libnspr4.so
>>>>>> No symbol table info available.
>>>>>> #5 0x00007f1b48dc1dc5 in start_thread () from /lib64/libpthread.so.0
>>>>>> No symbol table info available.
>>>>>> #6 0x00007f1b48aef28d in clone () from /lib64/libc.so.6
>>>>>> No symbol table info available.
>>>>>>
>>>>>> Thread 31 (Thread 0x7f1b097f2700 (LWP 105191)):
>>>>>> #0 0x00007f1b48dc56d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>>>> No symbol table info available.
>>>>>> #1 0x00007f1b4941b050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>>>>> No symbol table info available.
>>>>>> #2 0x00007f1b4b70efee in connection_wait_for_new_work ()
>>>>>> No symbol table info available.
>>>>>> #3 0x00007f1b4b710719 in connection_threadmain ()
>>>>>> No symbol table info available.
>>>>>> #4 0x00007f1b494207bb in _pt_root () from /lib64/libnspr4.so
>>>>>> No symbol table info available.
>>>>>> #5 0x00007f1b48dc1dc5 in start_thread () from /lib64/libpthread.so.0
>>>>>> No symbol table info available.
>>>>>> #6 0x00007f1b48aef28d in clone () from /lib64/libc.so.6
>>>>>> No symbol table info available.
>>>>>>
>>>>>> Thread 30 (Thread 0x7f1b09ff3700 (LWP 105190)):
>>>>>> #0 0x00007f1b48dc56d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>>>> No symbol table info available.
>>>>>> #1 0x00007f1b433212f3 in __db_hybrid_mutex_suspend () from /lib64/
>>>>>> libdb-5.3.so
>>>>>> No symbol table info available.
>>>>>> #2 0x00007f1b43320640 in __db_tas_mutex_lock () from /lib64/
>>>>>> libdb-5.3.so
>>>>>> No symbol table info available.
>>>>>> #3 0x00007f1b433cad3a in __lock_get_internal () from /lib64/
>>>>>> libdb-5.3.so
>>>>>> No symbol table info available.
>>>>>> #4 0x00007f1b433cb820 in __lock_get () from /lib64/libdb-5.3.so
>>>>>> No symbol table info available.
>>>>>> #5 0x00007f1b433f7142 in __db_lget () from /lib64/libdb-5.3.so
>>>>>> No symbol table info available.
>>>>>> #6 0x00007f1b4333e605 in __bam_search () from /lib64/libdb-5.3.so
>>>>>> No symbol table info available.
>>>>>> #7 0x00007f1b43329256 in __bamc_search () from /lib64/libdb-5.3.so
>>>>>> No symbol table info available.
>>>>>> #8 0x00007f1b4332ad0f in __bamc_get () from /lib64/libdb-5.3.so
>>>>>> No symbol table info available.
>>>>>> #9 0x00007f1b433e3ca6 in __dbc_iget () from /lib64/libdb-5.3.so
>>>>>> No symbol table info available.
>>>>>> #10 0x00007f1b433f2b02 in __dbc_get_pp () from /lib64/libdb-5.3.so
>>>>>> No symbol table info available.
>>>>>> #11 0x00007f1b3e8ce680 in idl_new_fetch () from
>>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>>> No symbol table info available.
>>>>>> #12 0x00007f1b3e8dcb26 in index_read_ext_allids () from
>>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>>> No symbol table info available.
>>>>>> #13 0x00007f1b3e8c7284 in keys2idl () from
>>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>>> No symbol table info available.
>>>>>> #14 0x00007f1b3e8c79e3 in ava_candidates.isra.0 () from
>>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>>> No symbol table info available.
>>>>>> #15 0x00007f1b3e8c7fd2 in filter_candidates_ext () from
>>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>>> No symbol table info available.
>>>>>> #16 0x00007f1b3e8c9096 in list_candidates () from
>>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>>> No symbol table info available.
>>>>>> #17 0x00007f1b3e8c7f40 in filter_candidates_ext () from
>>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>>> No symbol table info available.
>>>>>> #18 0x00007f1b3e8c9096 in list_candidates () from
>>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>>> No symbol table info available.
>>>>>> #19 0x00007f1b3e8c7f40 in filter_candidates_ext () from
>>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>>> No symbol table info available.
>>>>>> #20 0x00007f1b3e8c9096 in list_candidates () from
>>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>>> No symbol table info available.
>>>>>> #21 0x00007f1b3e8c7f40 in filter_candidates_ext () from
>>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>>> No symbol table info available.
>>>>>> #22 0x00007f1b3e90380c in subtree_candidates () from
>>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>>> No symbol table info available.
>>>>>> #23 0x00007f1b3e904e7f in ldbm_back_search () from
>>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>>> No symbol table info available.
>>>>>> #24 0x00007f1b4b2321d6 in op_shared_search () from
>>>>>> /usr/lib64/dirsrv/libslapd.so.0
>>>>>> No symbol table info available.
>>>>>> #25 0x00007f1b4b72333e in do_search ()
>>>>>> No symbol table info available.
>>>>>> #26 0x00007f1b4b7113c3 in connection_threadmain ()
>>>>>> No symbol table info available.
>>>>>> #27 0x00007f1b494207bb in _pt_root () from /lib64/libnspr4.so
>>>>>> No symbol table info available.
>>>>>> #28 0x00007f1b48dc1dc5 in start_thread () from /lib64/libpthread.so.0
>>>>>> No symbol table info available.
>>>>>> #29 0x00007f1b48aef28d in clone () from /lib64/libc.so.6
>>>>>> No symbol table info available.
>>>>>>
>>>>>> Thread 29 (Thread 0x7f1b0a7f4700 (LWP 105189)):
>>>>>> #0 0x00007f1b48dc56d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>>>> No symbol table info available.
>>>>>> #1 0x00007f1b4941b050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>>>>> No symbol table info available.
>>>>>> #2 0x00007f1b4b70efee in connection_wait_for_new_work ()
>>>>>> No symbol table info available.
>>>>>> #3 0x00007f1b4b710719 in connection_threadmain ()
>>>>>> No symbol table info available.
>>>>>> #4 0x00007f1b494207bb in _pt_root () from /lib64/libnspr4.so
>>>>>> No symbol table info available.
>>>>>> #5 0x00007f1b48dc1dc5 in start_thread () from /lib64/libpthread.so.0
>>>>>> No symbol table info available.
>>>>>> #6 0x00007f1b48aef28d in clone () from /lib64/libc.so.6
>>>>>> No symbol table info available.
>>>>>>
>>>>>> Thread 28 (Thread 0x7f1b0aff5700 (LWP 105188)):
>>>>>> #0 0x00007f1b48dc56d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>>>> No symbol table info available.
>>>>>> #1 0x00007f1b4941b050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>>>>> No symbol table info available.
>>>>>> #2 0x00007f1b4b70efee in connection_wait_for_new_work ()
>>>>>> No symbol table info available.
>>>>>> #3 0x00007f1b4b710719 in connection_threadmain ()
>>>>>> No symbol table info available.
>>>>>> #4 0x00007f1b494207bb in _pt_root () from /lib64/libnspr4.so
>>>>>> No symbol table info available.
>>>>>> #5 0x00007f1b48dc1dc5 in start_thread () from /lib64/libpthread.so.0
>>>>>> No symbol table info available.
>>>>>> #6 0x00007f1b48aef28d in clone () from /lib64/libc.so.6
>>>>>> No symbol table info available.
>>>>>>
>>>>>> Thread 27 (Thread 0x7f1b0b7f6700 (LWP 105187)):
>>>>>> #0 0x00007f1b48dc56d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>>>> No symbol table info available.
>>>>>> #1 0x00007f1b4941b050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>>>>> No symbol table info available.
>>>>>> #2 0x00007f1b4b70efee in connection_wait_for_new_work ()
>>>>>> No symbol table info available.
>>>>>> #3 0x00007f1b4b710719 in connection_threadmain ()
>>>>>> No symbol table info available.
>>>>>> #4 0x00007f1b494207bb in _pt_root () from /lib64/libnspr4.so
>>>>>> No symbol table info available.
>>>>>> #5 0x00007f1b48dc1dc5 in start_thread () from /lib64/libpthread.so.0
>>>>>> No symbol table info available.
>>>>>> #6 0x00007f1b48aef28d in clone () from /lib64/libc.so.6
>>>>>> No symbol table info available.
>>>>>>
>>>>>> Thread 26 (Thread 0x7f1b0bff7700 (LWP 105186)):
>>>>>> #0 0x00007f1b48dc56d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>>>> No symbol table info available.
>>>>>> #1 0x00007f1b433212f3 in __db_hybrid_mutex_suspend () from /lib64/
>>>>>> libdb-5.3.so
>>>>>> No symbol table info available.
>>>>>> #2 0x00007f1b43320640 in __db_tas_mutex_lock () from /lib64/
>>>>>> libdb-5.3.so
>>>>>> No symbol table info available.
>>>>>> #3 0x00007f1b433cad3a in __lock_get_internal () from /lib64/
>>>>>> libdb-5.3.so
>>>>>> No symbol table info available.
>>>>>> #4 0x00007f1b433cb820 in __lock_get () from /lib64/libdb-5.3.so
>>>>>> No symbol table info available.
>>>>>> #5 0x00007f1b433f7142 in __db_lget () from /lib64/libdb-5.3.so
>>>>>> No symbol table info available.
>>>>>> #6 0x00007f1b4333e605 in __bam_search () from /lib64/libdb-5.3.so
>>>>>> No symbol table info available.
>>>>>> #7 0x00007f1b43329256 in __bamc_search () from /lib64/libdb-5.3.so
>>>>>> No symbol table info available.
>>>>>> #8 0x00007f1b4332ad0f in __bamc_get () from /lib64/libdb-5.3.so
>>>>>> No symbol table info available.
>>>>>> #9 0x00007f1b433e3ca6 in __dbc_iget () from /lib64/libdb-5.3.so
>>>>>> No symbol table info available.
>>>>>> #10 0x00007f1b433f2b02 in __dbc_get_pp () from /lib64/libdb-5.3.so
>>>>>> No symbol table info available.
>>>>>> #11 0x00007f1b3e8ce680 in idl_new_fetch () from
>>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>>> No symbol table info available.
>>>>>> #12 0x00007f1b3e8dcb26 in index_read_ext_allids () from
>>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>>> No symbol table info available.
>>>>>> #13 0x00007f1b3e8c7284 in keys2idl () from
>>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>>> No symbol table info available.
>>>>>> #14 0x00007f1b3e8c79e3 in ava_candidates.isra.0 () from
>>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>>> No symbol table info available.
>>>>>> #15 0x00007f1b3e8c7fd2 in filter_candidates_ext () from
>>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>>> No symbol table info available.
>>>>>> #16 0x00007f1b3e8c9096 in list_candidates () from
>>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>>> No symbol table info available.
>>>>>> #17 0x00007f1b3e8c7f40 in filter_candidates_ext () from
>>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>>> No symbol table info available.
>>>>>> #18 0x00007f1b3e90380c in subtree_candidates () from
>>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>>> No symbol table info available.
>>>>>> #19 0x00007f1b3e904e7f in ldbm_back_search () from
>>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>>> No symbol table info available.
>>>>>> #20 0x00007f1b4b2321d6 in op_shared_search () from
>>>>>> /usr/lib64/dirsrv/libslapd.so.0
>>>>>> No symbol table info available.
>>>>>> #21 0x00007f1b4b24294e in search_internal_callback_pb () from
>>>>>> /usr/lib64/dirsrv/libslapd.so.0
>>>>>> No symbol table info available.
>>>>>> #22 0x00007f1b4b242be8 in search_internal_pb () from
>>>>>> /usr/lib64/dirsrv/libslapd.so.0
>>>>>> No symbol table info available.
>>>>>> #23 0x00007f1b4b72149b in ids_sasl_canon_user ()
>>>>>> No symbol table info available.
>>>>>> #24 0x00007f1b491e193b in _sasl_canon_user () from
>>>>>> /lib64/libsasl2.so.3
>>>>>> No symbol table info available.
>>>>>> #25 0x00007f1b491e1c4c in _sasl_canon_user_lookup () from
>>>>>> /lib64/libsasl2.so.3
>>>>>> No symbol table info available.
>>>>>> #26 0x00007f1b430e9fb9 in gssapi_server_mech_step () from
>>>>>> /usr/lib64/sasl2/libgssapiv2.so
>>>>>> No symbol table info available.
>>>>>> #27 0x00007f1b491edb9b in sasl_server_step () from
>>>>>> /lib64/libsasl2.so.3
>>>>>> No symbol table info available.
>>>>>> #28 0x00007f1b4b72283b in ids_sasl_check_bind ()
>>>>>> No symbol table info available.
>>>>>> #29 0x00007f1b4b70a61a in do_bind ()
>>>>>> No symbol table info available.
>>>>>> #30 0x00007f1b4b7113fd in connection_threadmain ()
>>>>>> No symbol table info available.
>>>>>> #31 0x00007f1b494207bb in _pt_root () from /lib64/libnspr4.so
>>>>>> No symbol table info available.
>>>>>> #32 0x00007f1b48dc1dc5 in start_thread () from /lib64/libpthread.so.0
>>>>>> No symbol table info available.
>>>>>> #33 0x00007f1b48aef28d in clone () from /lib64/libc.so.6
>>>>>> No symbol table info available.
>>>>>>
>>>>>> Thread 25 (Thread 0x7f1b0c7f8700 (LWP 105185)):
>>>>>> #0 0x00007f1b48dc56d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>>>> No symbol table info available.
>>>>>> #1 0x00007f1b4941b050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>>>>> No symbol table info available.
>>>>>> #2 0x00007f1b4b70efee in connection_wait_for_new_work ()
>>>>>> No symbol table info available.
>>>>>> #3 0x00007f1b4b710719 in connection_threadmain ()
>>>>>> No symbol table info available.
>>>>>> #4 0x00007f1b494207bb in _pt_root () from /lib64/libnspr4.so
>>>>>> No symbol table info available.
>>>>>> #5 0x00007f1b48dc1dc5 in start_thread () from /lib64/libpthread.so.0
>>>>>> No symbol table info available.
>>>>>> #6 0x00007f1b48aef28d in clone () from /lib64/libc.so.6
>>>>>> No symbol table info available.
>>>>>>
>>>>>> Thread 24 (Thread 0x7f1b0cff9700 (LWP 105184)):
>>>>>> #0 0x00007f1b48dc56d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>>>> No symbol table info available.
>>>>>> #1 0x00007f1b4941b050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>>>>> No symbol table info available.
>>>>>> #2 0x00007f1b4b70efee in connection_wait_for_new_work ()
>>>>>> No symbol table info available.
>>>>>> #3 0x00007f1b4b710719 in connection_threadmain ()
>>>>>> No symbol table info available.
>>>>>> #4 0x00007f1b494207bb in _pt_root () from /lib64/libnspr4.so
>>>>>> No symbol table info available.
>>>>>> #5 0x00007f1b48dc1dc5 in start_thread () from /lib64/libpthread.so.0
>>>>>> No symbol table info available.
>>>>>> #6 0x00007f1b48aef28d in clone () from /lib64/libc.so.6
>>>>>> No symbol table info available.
>>>>>>
>>>>>> Thread 23 (Thread 0x7f1b0d7fa700 (LWP 105183)):
>>>>>> #0 0x00007f1b48dc56d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>>>> No symbol table info available.
>>>>>> #1 0x00007f1b4941b050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>>>>> No symbol table info available.
>>>>>> #2 0x00007f1b4b70efee in connection_wait_for_new_work ()
>>>>>> No symbol table info available.
>>>>>> #3 0x00007f1b4b710719 in connection_threadmain ()
>>>>>> No symbol table info available.
>>>>>> #4 0x00007f1b494207bb in _pt_root () from /lib64/libnspr4.so
>>>>>> No symbol table info available.
>>>>>> #5 0x00007f1b48dc1dc5 in start_thread () from /lib64/libpthread.so.0
>>>>>> No symbol table info available.
>>>>>> #6 0x00007f1b48aef28d in clone () from /lib64/libc.so.6
>>>>>> No symbol table info available.
>>>>>>
>>>>>> Thread 22 (Thread 0x7f1b0dffb700 (LWP 105182)):
>>>>>> #0 0x00007f1b48dc56d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>>>> No symbol table info available.
>>>>>> #1 0x00007f1b4941b050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>>>>> No symbol table info available.
>>>>>> #2 0x00007f1b4b70efee in connection_wait_for_new_work ()
>>>>>> No symbol table info available.
>>>>>> #3 0x00007f1b4b710719 in connection_threadmain ()
>>>>>> No symbol table info available.
>>>>>> #4 0x00007f1b494207bb in _pt_root () from /lib64/libnspr4.so
>>>>>> No symbol table info available.
>>>>>> #5 0x00007f1b48dc1dc5 in start_thread () from /lib64/libpthread.so.0
>>>>>> No symbol table info available.
>>>>>> #6 0x00007f1b48aef28d in clone () from /lib64/libc.so.6
>>>>>> No symbol table info available.
>>>>>>
>>>>>> Thread 21 (Thread 0x7f1b0e7fc700 (LWP 105181)):
>>>>>> #0 0x00007f1b48dc56d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>>>> No symbol table info available.
>>>>>> #1 0x00007f1b4941b050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>>>>> No symbol table info available.
>>>>>> #2 0x00007f1b4b70efee in connection_wait_for_new_work ()
>>>>>> No symbol table info available.
>>>>>> #3 0x00007f1b4b710719 in connection_threadmain ()
>>>>>> No symbol table info available.
>>>>>> #4 0x00007f1b494207bb in _pt_root () from /lib64/libnspr4.so
>>>>>> No symbol table info available.
>>>>>> #5 0x00007f1b48dc1dc5 in start_thread () from /lib64/libpthread.so.0
>>>>>> No symbol table info available.
>>>>>> #6 0x00007f1b48aef28d in clone () from /lib64/libc.so.6
>>>>>> No symbol table info available.
>>>>>>
>>>>>> Thread 20 (Thread 0x7f1b0effd700 (LWP 105180)):
>>>>>> #0 0x00007f1b48dc56d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>>>> No symbol table info available.
>>>>>> #1 0x00007f1b433212f3 in __db_hybrid_mutex_suspend () from /lib64/
>>>>>> libdb-5.3.so
>>>>>> No symbol table info available.
>>>>>> #2 0x00007f1b43320b37 in __db_tas_mutex_readlock () from /lib64/
>>>>>> libdb-5.3.so
>>>>>> No symbol table info available.
>>>>>> #3 0x00007f1b4343ad35 in __memp_fget () from /lib64/libdb-5.3.so
>>>>>> No symbol table info available.
>>>>>> #4 0x00007f1b433e4333 in __dbc_iget () from /lib64/libdb-5.3.so
>>>>>> No symbol table info available.
>>>>>> #5 0x00007f1b433f2b02 in __dbc_get_pp () from /lib64/libdb-5.3.so
>>>>>> No symbol table info available.
>>>>>> #6 0x00007f1b3e8ce822 in idl_new_fetch () from
>>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>>> No symbol table info available.
>>>>>> #7 0x00007f1b3e8dcb26 in index_read_ext_allids () from
>>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>>> No symbol table info available.
>>>>>> #8 0x00007f1b3e8c7284 in keys2idl () from
>>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>>> No symbol table info available.
>>>>>> #9 0x00007f1b3e8c79e3 in ava_candidates.isra.0 () from
>>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>>> No symbol table info available.
>>>>>> #10 0x00007f1b3e8c7fd2 in filter_candidates_ext () from
>>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>>> No symbol table info available.
>>>>>> #11 0x00007f1b3e8c9096 in list_candidates () from
>>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>>> No symbol table info available.
>>>>>> #12 0x00007f1b3e8c7f40 in filter_candidates_ext () from
>>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>>> No symbol table info available.
>>>>>> #13 0x00007f1b3e8c9096 in list_candidates () from
>>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>>> No symbol table info available.
>>>>>> #14 0x00007f1b3e8c7f40 in filter_candidates_ext () from
>>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>>> No symbol table info available.
>>>>>> #15 0x00007f1b3e8c9096 in list_candidates () from
>>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>>> No symbol table info available.
>>>>>> #16 0x00007f1b3e8c7f40 in filter_candidates_ext () from
>>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>>> No symbol table info available.
>>>>>> #17 0x00007f1b3e90380c in subtree_candidates () from
>>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>>> No symbol table info available.
>>>>>> #18 0x00007f1b3e904e7f in ldbm_back_search () from
>>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>>> No symbol table info available.
>>>>>> #19 0x00007f1b4b2321d6 in op_shared_search () from
>>>>>> /usr/lib64/dirsrv/libslapd.so.0
>>>>>> No symbol table info available.
>>>>>> #20 0x00007f1b4b72333e in do_search ()
>>>>>> No symbol table info available.
>>>>>> #21 0x00007f1b4b7113c3 in connection_threadmain ()
>>>>>> No symbol table info available.
>>>>>> #22 0x00007f1b494207bb in _pt_root () from /lib64/libnspr4.so
>>>>>> No symbol table info available.
>>>>>> #23 0x00007f1b48dc1dc5 in start_thread () from /lib64/libpthread.so.0
>>>>>> No symbol table info available.
>>>>>> #24 0x00007f1b48aef28d in clone () from /lib64/libc.so.6
>>>>>> No symbol table info available.
>>>>>>
>>>>>> Thread 19 (Thread 0x7f1b0f7fe700 (LWP 105179)):
>>>>>> #0 0x00007f1b48dc56d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>>>> No symbol table info available.
>>>>>> #1 0x00007f1b433212f3 in __db_hybrid_mutex_suspend () from /lib64/
>>>>>> libdb-5.3.so
>>>>>> No symbol table info available.
>>>>>> #2 0x00007f1b43320640 in __db_tas_mutex_lock () from /lib64/
>>>>>> libdb-5.3.so
>>>>>> No symbol table info available.
>>>>>> #3 0x00007f1b433cad3a in __lock_get_internal () from /lib64/
>>>>>> libdb-5.3.so
>>>>>> No symbol table info available.
>>>>>> #4 0x00007f1b433cb820 in __lock_get () from /lib64/libdb-5.3.so
>>>>>> No symbol table info available.
>>>>>> #5 0x00007f1b433f7142 in __db_lget () from /lib64/libdb-5.3.so
>>>>>> No symbol table info available.
>>>>>> #6 0x00007f1b4333e605 in __bam_search () from /lib64/libdb-5.3.so
>>>>>> No symbol table info available.
>>>>>> #7 0x00007f1b43329256 in __bamc_search () from /lib64/libdb-5.3.so
>>>>>> No symbol table info available.
>>>>>> #8 0x00007f1b4332ad0f in __bamc_get () from /lib64/libdb-5.3.so
>>>>>> No symbol table info available.
>>>>>> #9 0x00007f1b433e3ca6 in __dbc_iget () from /lib64/libdb-5.3.so
>>>>>> No symbol table info available.
>>>>>> #10 0x00007f1b433f2b02 in __dbc_get_pp () from /lib64/libdb-5.3.so
>>>>>> No symbol table info available.
>>>>>> #11 0x00007f1b3e8ce680 in idl_new_fetch () from
>>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>>> No symbol table info available.
>>>>>> #12 0x00007f1b3e8dcb26 in index_read_ext_allids () from
>>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>>> No symbol table info available.
>>>>>> #13 0x00007f1b3e8c7284 in keys2idl () from
>>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>>> No symbol table info available.
>>>>>> #14 0x00007f1b3e8c79e3 in ava_candidates.isra.0 () from
>>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>>> No symbol table info available.
>>>>>> #15 0x00007f1b3e8c7fd2 in filter_candidates_ext () from
>>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>>> No symbol table info available.
>>>>>> #16 0x00007f1b3e8c9096 in list_candidates () from
>>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>>> No symbol table info available.
>>>>>> #17 0x00007f1b3e8c7f40 in filter_candidates_ext () from
>>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>>> No symbol table info available.
>>>>>> #18 0x00007f1b3e8c9096 in list_candidates () from
>>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>>> No symbol table info available.
>>>>>> #19 0x00007f1b3e8c7f40 in filter_candidates_ext () from
>>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>>> No symbol table info available.
>>>>>> #20 0x00007f1b3e8c9096 in list_candidates () from
>>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>>> No symbol table info available.
>>>>>> #21 0x00007f1b3e8c7f40 in filter_candidates_ext () from
>>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>>> No symbol table info available.
>>>>>> #22 0x00007f1b3e90380c in subtree_candidates () from
>>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>>> No symbol table info available.
>>>>>> #23 0x00007f1b3e904e7f in ldbm_back_search () from
>>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>>> No symbol table info available.
>>>>>> #24 0x00007f1b4b2321d6 in op_shared_search () from
>>>>>> /usr/lib64/dirsrv/libslapd.so.0
>>>>>> No symbol table info available.
>>>>>> #25 0x00007f1b4b72333e in do_search ()
>>>>>> No symbol table info available.
>>>>>> #26 0x00007f1b4b7113c3 in connection_threadmain ()
>>>>>> No symbol table info available.
>>>>>> #27 0x00007f1b494207bb in _pt_root () from /lib64/libnspr4.so
>>>>>> No symbol table info available.
>>>>>> #28 0x00007f1b48dc1dc5 in start_thread () from /lib64/libpthread.so.0
>>>>>> No symbol table info available.
>>>>>> #29 0x00007f1b48aef28d in clone () from /lib64/libc.so.6
>>>>>> No symbol table info available.
>>>>>>
>>>>>> Thread 18 (Thread 0x7f1b0ffff700 (LWP 105178)):
>>>>>> #0 0x00007f1b48dc56d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>>>> No symbol table info available.
>>>>>> #1 0x00007f1b4941b050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>>>>> No symbol table info available.
>>>>>> #2 0x00007f1b4b70efee in connection_wait_for_new_work ()
>>>>>> No symbol table info available.
>>>>>> #3 0x00007f1b4b710719 in connection_threadmain ()
>>>>>> No symbol table info available.
>>>>>> #4 0x00007f1b494207bb in _pt_root () from /lib64/libnspr4.so
>>>>>> No symbol table info available.
>>>>>> #5 0x00007f1b48dc1dc5 in start_thread () from /lib64/libpthread.so.0
>>>>>> No symbol table info available.
>>>>>> #6 0x00007f1b48aef28d in clone () from /lib64/libc.so.6
>>>>>> No symbol table info available.
>>>>>>
>>>>>> Thread 17 (Thread 0x7f1b14d28700 (LWP 105177)):
>>>>>> #0 0x00007f1b48dc56d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>>>> No symbol table info available.
>>>>>> #1 0x00007f1b4941b050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>>>>> No symbol table info available.
>>>>>> #2 0x00007f1b4b70efee in connection_wait_for_new_work ()
>>>>>> No symbol table info available.
>>>>>> #3 0x00007f1b4b710719 in connection_threadmain ()
>>>>>> No symbol table info available.
>>>>>> #4 0x00007f1b494207bb in _pt_root () from /lib64/libnspr4.so
>>>>>> No symbol table info available.
>>>>>> #5 0x00007f1b48dc1dc5 in start_thread () from /lib64/libpthread.so.0
>>>>>> No symbol table info available.
>>>>>> #6 0x00007f1b48aef28d in clone () from /lib64/libc.so.6
>>>>>> No symbol table info available.
>>>>>>
>>>>>> Thread 16 (Thread 0x7f1b15529700 (LWP 105176)):
>>>>>> #0 0x00007f1b48dc56d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>>>> No symbol table info available.
>>>>>> #1 0x00007f1b4941b050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>>>>> No symbol table info available.
>>>>>> #2 0x00007f1b4b70efee in connection_wait_for_new_work ()
>>>>>> No symbol table info available.
>>>>>> #3 0x00007f1b4b710719 in connection_threadmain ()
>>>>>> No symbol table info available.
>>>>>> #4 0x00007f1b494207bb in _pt_root () from /lib64/libnspr4.so
>>>>>> No symbol table info available.
>>>>>> #5 0x00007f1b48dc1dc5 in start_thread () from /lib64/libpthread.so.0
>>>>>> No symbol table info available.
>>>>>> #6 0x00007f1b48aef28d in clone () from /lib64/libc.so.6
>>>>>> No symbol table info available.
>>>>>>
>>>>>> Thread 15 (Thread 0x7f1b15d2a700 (LWP 105175)):
>>>>>> #0 0x00007f1b48dc56d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>>>> No symbol table info available.
>>>>>> #1 0x00007f1b4941b050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>>>>> No symbol table info available.
>>>>>> #2 0x00007f1b4b70efee in connection_wait_for_new_work ()
>>>>>> No symbol table info available.
>>>>>> #3 0x00007f1b4b710719 in connection_threadmain ()
>>>>>> No symbol table info available.
>>>>>> #4 0x00007f1b494207bb in _pt_root () from /lib64/libnspr4.so
>>>>>> No symbol table info available.
>>>>>> #5 0x00007f1b48dc1dc5 in start_thread () from /lib64/libpthread.so.0
>>>>>> No symbol table info available.
>>>>>> #6 0x00007f1b48aef28d in clone () from /lib64/libc.so.6
>>>>>> No symbol table info available.
>>>>>>
>>>>>> Thread 14 (Thread 0x7f1b1652b700 (LWP 105174)):
>>>>>> #0 0x00007f1b48dc56d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>>>> No symbol table info available.
>>>>>> #1 0x00007f1b4941b050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>>>>> No symbol table info available.
>>>>>> #2 0x00007f1b4b70efee in connection_wait_for_new_work ()
>>>>>> No symbol table info available.
>>>>>> #3 0x00007f1b4b710719 in connection_threadmain ()
>>>>>> No symbol table info available.
>>>>>> #4 0x00007f1b494207bb in _pt_root () from /lib64/libnspr4.so
>>>>>> No symbol table info available.
>>>>>> #5 0x00007f1b48dc1dc5 in start_thread () from /lib64/libpthread.so.0
>>>>>> No symbol table info available.
>>>>>> #6 0x00007f1b48aef28d in clone () from /lib64/libc.so.6
>>>>>> No symbol table info available.
>>>>>>
>>>>>> Thread 13 (Thread 0x7f1b16d2c700 (LWP 105173)):
>>>>>> #0 0x00007f1b48dc56d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>>>> No symbol table info available.
>>>>>> #1 0x00007f1b433212f3 in __db_hybrid_mutex_suspend () from /lib64/
>>>>>> libdb-5.3.so
>>>>>> No symbol table info available.
>>>>>> #2 0x00007f1b43320640 in __db_tas_mutex_lock () from /lib64/
>>>>>> libdb-5.3.so
>>>>>> No symbol table info available.
>>>>>> #3 0x00007f1b433cad3a in __lock_get_internal () from /lib64/
>>>>>> libdb-5.3.so
>>>>>> No symbol table info available.
>>>>>> #4 0x00007f1b433cb820 in __lock_get () from /lib64/libdb-5.3.so
>>>>>> No symbol table info available.
>>>>>> #5 0x00007f1b433f7142 in __db_lget () from /lib64/libdb-5.3.so
>>>>>> No symbol table info available.
>>>>>> #6 0x00007f1b4333e605 in __bam_search () from /lib64/libdb-5.3.so
>>>>>> No symbol table info available.
>>>>>> #7 0x00007f1b43329256 in __bamc_search () from /lib64/libdb-5.3.so
>>>>>> No symbol table info available.
>>>>>> #8 0x00007f1b4332ad0f in __bamc_get () from /lib64/libdb-5.3.so
>>>>>> No symbol table info available.
>>>>>> #9 0x00007f1b433e3ca6 in __dbc_iget () from /lib64/libdb-5.3.so
>>>>>> No symbol table info available.
>>>>>> #10 0x00007f1b433f2b02 in __dbc_get_pp () from /lib64/libdb-5.3.so
>>>>>> No symbol table info available.
>>>>>> #11 0x00007f1b3e8ce680 in idl_new_fetch () from
>>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>>> No symbol table info available.
>>>>>> #12 0x00007f1b3e8dcb26 in index_read_ext_allids () from
>>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>>> No symbol table info available.
>>>>>> #13 0x00007f1b3e8c7284 in keys2idl () from
>>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>>> No symbol table info available.
>>>>>> #14 0x00007f1b3e8c79e3 in ava_candidates.isra.0 () from
>>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>>> No symbol table info available.
>>>>>> #15 0x00007f1b3e8c7fd2 in filter_candidates_ext () from
>>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>>> No symbol table info available.
>>>>>> #16 0x00007f1b3e8c9096 in list_candidates () from
>>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>>> No symbol table info available.
>>>>>> #17 0x00007f1b3e8c7f40 in filter_candidates_ext () from
>>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>>> No symbol table info available.
>>>>>> #18 0x00007f1b3e8c9096 in list_candidates () from
>>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>>> No symbol table info available.
>>>>>> #19 0x00007f1b3e8c7f40 in filter_candidates_ext () from
>>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>>> No symbol table info available.
>>>>>> #20 0x00007f1b3e8c9096 in list_candidates () from
>>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>>> No symbol table info available.
>>>>>> #21 0x00007f1b3e8c7f40 in filter_candidates_ext () from
>>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>>> No symbol table info available.
>>>>>> #22 0x00007f1b3e90380c in subtree_candidates () from
>>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>>> No symbol table info available.
>>>>>> #23 0x00007f1b3e904e7f in ldbm_back_search () from
>>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>>> No symbol table info available.
>>>>>> #24 0x00007f1b4b2321d6 in op_shared_search () from
>>>>>> /usr/lib64/dirsrv/libslapd.so.0
>>>>>> No symbol table info available.
>>>>>> #25 0x00007f1b4b72333e in do_search ()
>>>>>> No symbol table info available.
>>>>>> #26 0x00007f1b4b7113c3 in connection_threadmain ()
>>>>>> No symbol table info available.
>>>>>> #27 0x00007f1b494207bb in _pt_root () from /lib64/libnspr4.so
>>>>>> No symbol table info available.
>>>>>> #28 0x00007f1b48dc1dc5 in start_thread () from /lib64/libpthread.so.0
>>>>>> No symbol table info available.
>>>>>> #29 0x00007f1b48aef28d in clone () from /lib64/libc.so.6
>>>>>> No symbol table info available.
>>>>>>
>>>>>> Thread 12 (Thread 0x7f1b1752d700 (LWP 105172)):
>>>>>> #0 0x00007f1b48dc56d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>>>> No symbol table info available.
>>>>>> #1 0x00007f1b4941b050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>>>>> No symbol table info available.
>>>>>> #2 0x00007f1b4b70efee in connection_wait_for_new_work ()
>>>>>> No symbol table info available.
>>>>>> #3 0x00007f1b4b710719 in connection_threadmain ()
>>>>>> No symbol table info available.
>>>>>> #4 0x00007f1b494207bb in _pt_root () from /lib64/libnspr4.so
>>>>>> No symbol table info available.
>>>>>> #5 0x00007f1b48dc1dc5 in start_thread () from /lib64/libpthread.so.0
>>>>>> No symbol table info available.
>>>>>> #6 0x00007f1b48aef28d in clone () from /lib64/libc.so.6
>>>>>> No symbol table info available.
>>>>>>
>>>>>> Thread 11 (Thread 0x7f1b17d2e700 (LWP 105171)):
>>>>>> #0 0x00007f1b48dc56d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>>>> No symbol table info available.
>>>>>> #1 0x00007f1b4941b050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>>>>> No symbol table info available.
>>>>>> #2 0x00007f1b4b70efee in connection_wait_for_new_work ()
>>>>>> No symbol table info available.
>>>>>> #3 0x00007f1b4b710719 in connection_threadmain ()
>>>>>> No symbol table info available.
>>>>>> #4 0x00007f1b494207bb in _pt_root () from /lib64/libnspr4.so
>>>>>> No symbol table info available.
>>>>>> #5 0x00007f1b48dc1dc5 in start_thread () from /lib64/libpthread.so.0
>>>>>> No symbol table info available.
>>>>>> #6 0x00007f1b48aef28d in clone () from /lib64/libc.so.6
>>>>>> No symbol table info available.
>>>>>>
>>>>>> Thread 10 (Thread 0x7f1b2509d700 (LWP 105168)):
>>>>>> #0 0x00007f1b48dc5a82 in pthread_cond_timedwait@@GLIBC_2.3.2 ()
>>>>>> from /lib64/libpthread.so.0
>>>>>> No symbol table info available.
>>>>>> #1 0x00007f1b4941ab07 in pt_TimedWait () from /lib64/libnspr4.so
>>>>>> No symbol table info available.
>>>>>> #2 0x00007f1b4941afce in PR_WaitCondVar () from /lib64/libnspr4.so
>>>>>> No symbol table info available.
>>>>>> #3 0x00007f1b4b2061e8 in eq_loop () from
>>>>>> /usr/lib64/dirsrv/libslapd.so.0
>>>>>> No symbol table info available.
>>>>>> #4 0x00007f1b494207bb in _pt_root () from /lib64/libnspr4.so
>>>>>> No symbol table info available.
>>>>>> #5 0x00007f1b48dc1dc5 in start_thread () from /lib64/libpthread.so.0
>>>>>> No symbol table info available.
>>>>>> #6 0x00007f1b48aef28d in clone () from /lib64/libc.so.6
>>>>>> No symbol table info available.
>>>>>>
>>>>>> Thread 9 (Thread 0x7f1b2589e700 (LWP 105167)):
>>>>>> #0 0x00007f1b48dc5a82 in pthread_cond_timedwait@@GLIBC_2.3.2 ()
>>>>>> from /lib64/libpthread.so.0
>>>>>> No symbol table info available.
>>>>>> #1 0x00007f1b4941ab07 in pt_TimedWait () from /lib64/libnspr4.so
>>>>>> No symbol table info available.
>>>>>> #2 0x00007f1b4941afce in PR_WaitCondVar () from /lib64/libnspr4.so
>>>>>> No symbol table info available.
>>>>>> #3 0x00007f1b4b719d03 in housecleaning ()
>>>>>> No symbol table info available.
>>>>>> #4 0x00007f1b494207bb in _pt_root () from /lib64/libnspr4.so
>>>>>> No symbol table info available.
>>>>>> #5 0x00007f1b48dc1dc5 in start_thread () from /lib64/libpthread.so.0
>>>>>> No symbol table info available.
>>>>>> #6 0x00007f1b48aef28d in clone () from /lib64/libc.so.6
>>>>>> No symbol table info available.
>>>>>>
>>>>>> Thread 8 (Thread 0x7f1b2609f700 (LWP 105166)):
>>>>>> #0 0x00007f1b48dc56d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>>>> No symbol table info available.
>>>>>> #1 0x00007f1b4941b050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>>>>> No symbol table info available.
>>>>>> #2 0x00007f1b4b260198 in slapi_wait_condvar () from
>>>>>> /usr/lib64/dirsrv/libslapd.so.0
>>>>>> No symbol table info available.
>>>>>> #3 0x00007f1b3cf5deed in roles_cache_wait_on_change () from
>>>>>> /usr/lib64/dirsrv/plugins/libroles-plugin.so
>>>>>> No symbol table info available.
>>>>>> #4 0x00007f1b494207bb in _pt_root () from /lib64/libnspr4.so
>>>>>> No symbol table info available.
>>>>>> #5 0x00007f1b48dc1dc5 in start_thread () from /lib64/libpthread.so.0
>>>>>> No symbol table info available.
>>>>>> #6 0x00007f1b48aef28d in clone () from /lib64/libc.so.6
>>>>>> No symbol table info available.
>>>>>>
>>>>>> Thread 7 (Thread 0x7f1b268a0700 (LWP 105165)):
>>>>>> #0 0x00007f1b48dc56d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>>>> No symbol table info available.
>>>>>> #1 0x00007f1b4941b050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>>>>> No symbol table info available.
>>>>>> #2 0x00007f1b4b260198 in slapi_wait_condvar () from
>>>>>> /usr/lib64/dirsrv/libslapd.so.0
>>>>>> No symbol table info available.
>>>>>> #3 0x00007f1b3cf5deed in roles_cache_wait_on_change () from
>>>>>> /usr/lib64/dirsrv/plugins/libroles-plugin.so
>>>>>> No symbol table info available.
>>>>>> #4 0x00007f1b494207bb in _pt_root () from /lib64/libnspr4.so
>>>>>> No symbol table info available.
>>>>>> #5 0x00007f1b48dc1dc5 in start_thread () from /lib64/libpthread.so.0
>>>>>> No symbol table info available.
>>>>>> #6 0x00007f1b48aef28d in clone () from /lib64/libc.so.6
>>>>>> No symbol table info available.
>>>>>>
>>>>>> Thread 6 (Thread 0x7f1b270a1700 (LWP 105164)):
>>>>>> #0 0x00007f1b48dc56d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>>>> No symbol table info available.
>>>>>> #1 0x00007f1b4941b050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>>>>> No symbol table info available.
>>>>>> #2 0x00007f1b4b260198 in slapi_wait_condvar () from
>>>>>> /usr/lib64/dirsrv/libslapd.so.0
>>>>>> No symbol table info available.
>>>>>> #3 0x00007f1b3cf5deed in roles_cache_wait_on_change () from
>>>>>> /usr/lib64/dirsrv/plugins/libroles-plugin.so
>>>>>> No symbol table info available.
>>>>>> #4 0x00007f1b494207bb in _pt_root () from /lib64/libnspr4.so
>>>>>> No symbol table info available.
>>>>>> #5 0x00007f1b48dc1dc5 in start_thread () from /lib64/libpthread.so.0
>>>>>> No symbol table info available.
>>>>>> #6 0x00007f1b48aef28d in clone () from /lib64/libc.so.6
>>>>>> No symbol table info available.
>>>>>>
>>>>>> Thread 5 (Thread 0x7f1b278a2700 (LWP 105163)):
>>>>>> #0 0x00007f1b48dc56d5 in <pthread_cond_wait@@GLIBC_2.3.2>
>>>>>> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>>>>>> No symbol table info available.
>>>>>> #1 0x00007f1b4941b050 in PR_WaitCondVar () from /lib64/libnspr4.so
>>>>>> No symbol table info available.
>>>>>> #2 0x00007f1b4b260198 in slapi_wait_condvar () from
>>>>>> /usr/lib64/dirsrv/libslapd.so.0
>>>>>> No symbol table info available.
>>>>>> #3 0x00007f1b415f262e in cos_cache_wait_on_change () from
>>>>>> /usr/lib64/dirsrv/plugins/libcos-plugin.so
>>>>>> No symbol table info available.
>>>>>> #4 0x00007f1b494207bb in _pt_root () from /lib64/libnspr4.so
>>>>>> No symbol table info available.
>>>>>> #5 0x00007f1b48dc1dc5 in start_thread () from /lib64/libpthread.so.0
>>>>>> No symbol table info available.
>>>>>> #6 0x00007f1b48aef28d in clone () from /lib64/libc.so.6
>>>>>> No symbol table info available.
>>>>>>
>>>>>> Thread 4 (Thread 0x7f1b282ac700 (LWP 105162)):
>>>>>> #0 0x00007f1b48ae69b3 in select () from /lib64/libc.so.6
>>>>>> No symbol table info available.
>>>>>> #1 0x00007f1b4b2710e9 in DS_Sleep () from
>>>>>> /usr/lib64/dirsrv/libslapd.so.0
>>>>>> No symbol table info available.
>>>>>> #2 0x00007f1b3e8ba707 in perf_threadmain () from
>>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>>> No symbol table info available.
>>>>>> #3 0x00007f1b494207bb in _pt_root () from /lib64/libnspr4.so
>>>>>> No symbol table info available.
>>>>>> #4 0x00007f1b48dc1dc5 in start_thread () from /lib64/libpthread.so.0
>>>>>> No symbol table info available.
>>>>>> #5 0x00007f1b48aef28d in clone () from /lib64/libc.so.6
>>>>>> No symbol table info available.
>>>>>>
>>>>>> Thread 3 (Thread 0x7f1b28aad700 (LWP 105161)):
>>>>>> #0 0x00007f1b48ae69b3 in select () from /lib64/libc.so.6
>>>>>> No symbol table info available.
>>>>>> #1 0x00007f1b4b2710e9 in DS_Sleep () from
>>>>>> /usr/lib64/dirsrv/libslapd.so.0
>>>>>> No symbol table info available.
>>>>>> #2 0x00007f1b3e8bfb7f in trickle_threadmain () from
>>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>>> No symbol table info available.
>>>>>> #3 0x00007f1b494207bb in _pt_root () from /lib64/libnspr4.so
>>>>>> No symbol table info available.
>>>>>> #4 0x00007f1b48dc1dc5 in start_thread () from /lib64/libpthread.so.0
>>>>>> No symbol table info available.
>>>>>> #5 0x00007f1b48aef28d in clone () from /lib64/libc.so.6
>>>>>> No symbol table info available.
>>>>>>
>>>>>> Thread 2 (Thread 0x7f1b292ae700 (LWP 105160)):
>>>>>> #0 0x00007f1b48ae69b3 in select () from /lib64/libc.so.6
>>>>>> No symbol table info available.
>>>>>> #1 0x00007f1b4344dbad in __os_yield () from /lib64/libdb-5.3.so
>>>>>> No symbol table info available.
>>>>>> #2 0x00007f1b434492b3 in __memp_sync_int () from /lib64/libdb-5.3.so
>>>>>> No symbol table info available.
>>>>>> #3 0x00007f1b43459752 in __txn_checkpoint () from /lib64/
>>>>>> libdb-5.3.so
>>>>>> No symbol table info available.
>>>>>> #4 0x00007f1b43459b74 in __txn_checkpoint_pp () from /lib64/
>>>>>> libdb-5.3.so
>>>>>> No symbol table info available.
>>>>>> #5 0x00007f1b3e8c3a87 in checkpoint_threadmain () from
>>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>>> No symbol table info available.
>>>>>> #6 0x00007f1b494207bb in _pt_root () from /lib64/libnspr4.so
>>>>>> No symbol table info available.
>>>>>> #7 0x00007f1b48dc1dc5 in start_thread () from /lib64/libpthread.so.0
>>>>>> No symbol table info available.
>>>>>> #8 0x00007f1b48aef28d in clone () from /lib64/libc.so.6
>>>>>> No symbol table info available.
>>>>>>
>>>>>> Thread 1 (Thread 0x7f1b29aaf700 (LWP 105159)):
>>>>>> #0 0x00007f1b48ae69b3 in select () from /lib64/libc.so.6
>>>>>> No symbol table info available.
>>>>>> #1 0x00007f1b4b2710e9 in DS_Sleep () from
>>>>>> /usr/lib64/dirsrv/libslapd.so.0
>>>>>> No symbol table info available.
>>>>>> #2 0x00007f1b3e8bf907 in deadlock_threadmain () from
>>>>>> /usr/lib64/dirsrv/plugins/libback-ldbm.so
>>>>>> No symbol table info available.
>>>>>> #3 0x00007f1b494207bb in _pt_root () from /lib64/libnspr4.so
>>>>>> No symbol table info available.
>>>>>> #4 0x00007f1b48dc1dc5 in start_thread () from /lib64/libpthread.so.0
>>>>>> No symbol table info available.
>>>>>> #5 0x00007f1b48aef28d in clone () from /lib64/libc.so.6
>>>>>> No symbol table info available.
>>>>>>
>>>>>>
>>>>>>
>>>>>> Thanks,
>>>>>>
>>>>>> Rakesh
>>>>>>
>>>>>>
>>>>>> On Mon, Sep 5, 2016 at 4:48 PM, thierry bordaz < <tbordaz at redhat.com>
>>>>>> tbordaz at redhat.com> wrote:
>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> On 09/05/2016 12:05 PM, Rakesh Rajasekharan wrote:
>>>>>>>
>>>>>>> Hi Thierry,
>>>>>>>
>>>>>>>
>>>>>>> I was getting the hang issue while running ipa-client-install
>>>>>>> simultaneously on few clients..
>>>>>>> However, today, I am not able to replicate that.
>>>>>>>
>>>>>>> I could not get a gdb . But i will try getting that the next time I
>>>>>>> face this issue.
>>>>>>>
>>>>>>> The CPU does not stay high.. it just momentarily touches a high
>>>>>>> value and then drops down to around 2-7%
>>>>>>>
>>>>>>> One question I have is , is it ok to set it nsslapd-threadnumber to
>>>>>>> a very high value .
>>>>>>> I have around 4000 clients and with nsslapd-maxthreadsperconn set to
>>>>>>> 5..So, can I set nsslapd-threadnumber to around 25000.
>>>>>>>
>>>>>>>
>>>>>>> Hello,
>>>>>>>
>>>>>>> I know some users running in production with several hunderds of
>>>>>>> threads (>600) and this without problem.
>>>>>>>
>>>>>>> I do not recall having suggested to increase that number and for
>>>>>>> what reason.
>>>>>>> Usually 30 workers is a good enough value. It can create bootleneck
>>>>>>> if for some reason each operation is very long to satisfy and exhaust the
>>>>>>> number of workers. You can monitor the work queue:
>>>>>>>
>>>>>>> ldapsearch -D "cn=directory manager" -w xxx -LLL -b "cn=monitor" -s
>>>>>>> base opsinitiated opscompleted
>>>>>>>
>>>>>>>
>>>>>>> If opscompleted-opsinitiated remains close to threadnumber, then yes
>>>>>>> it would be valuable to increase it.
>>>>>>>
>>>>>>> The computation #client * #async_op_per_client sound an overkill.
>>>>>>> Even if all clients send at the exact same time all their requests, it is
>>>>>>> very likely that some common resource (db page, log, allocator...) will
>>>>>>> serialize them. If you monitor a need to increase the work, you would for
>>>>>>> example set it to 50, then monitor, then set it to 100, then monitor...
>>>>>>> until you find a good enough value.
>>>>>>> Note the increasing the #thread, increases the memory footprint that
>>>>>>> will reduce the efficiency of file system cache and can increase the
>>>>>>> response time.
>>>>>>>
>>>>>>>
>>>>>>> best regards
>>>>>>> thierry
>>>>>>>
>>>>>>>
>>>>>>> Thanks
>>>>>>>
>>>>>>> On Mon, Sep 5, 2016 at 1:03 PM, thierry bordaz <
>>>>>>> <tbordaz at redhat.com>tbordaz at redhat.com> wrote:
>>>>>>>
>>>>>>>>
>>>>>>>> Hi Rakesh,
>>>>>>>>
>>>>>>>> Were you able to get a pstack or full stack with gdb (
>>>>>>>> <http://www.port389.org/docs/>http://www.port389.org/docs/3
>>>>>>>> 89ds/FAQ/faq.html#debugging-crashes) when the server hangs ?
>>>>>>>>
>>>>>>>> If it happens with 500 threads as well as with 30, using 30 threads
>>>>>>>> is a better choice to debug this issue.
>>>>>>>> I will try to reproduce using 150 parallel 'ipa user-find
>>>>>>>> p-testipa' commands
>>>>>>>>
>>>>>>>> Something I am unsure is if the CPU consumption stays high (you
>>>>>>>> mentioned 340% CPU usage) as long as the hang happens or if after a suddent
>>>>>>>> shot up to 340% (that marks the beginning of the hang) it drops and stay
>>>>>>>> hanging ?
>>>>>>>>
>>>>>>>> thanks
>>>>>>>> thierry
>>>>>>>>
>>>>>>>> On 09/04/2016 08:40 PM, Rakesh Rajasekharan wrote:
>>>>>>>>
>>>>>>>> starce on the slapd process actually had this in the output..
>>>>>>>> FUTEX_WAIT_PRIVATE
>>>>>>>>
>>>>>>>> and checking for the number of threads slapd had.. there were 5015
>>>>>>>> threads
>>>>>>>>
>>>>>>>> ps -efL|grep slapd|wc -l
>>>>>>>> 5015
>>>>>>>>
>>>>>>>> strace on most of the threads gave this output
>>>>>>>>
>>>>>>>> strace -p 67411
>>>>>>>> Process 67411 attached
>>>>>>>> futex(0x7f3f0226b41c, FUTEX_WAIT_PRIVATE, 1, NULL) = -1 EAGAIN
>>>>>>>> (Resource temporarily unavailable)
>>>>>>>> futex(0x7f3f0226b41c, FUTEX_WAIT_PRIVATE, 2, NULL^CProcess 67411
>>>>>>>> detached
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> On Sun, Sep 4, 2016 at 5:34 PM, Rakesh Rajasekharan <
>>>>>>>> <rakesh.rajasekharan at gmail.com>rakesh.rajasekharan at gmail.com>
>>>>>>>> wrote:
>>>>>>>>
>>>>>>>>> I have again got the issue of IPA hanging.. The issue came up when
>>>>>>>>> i tried to run ipa-client-isntall on 142 clients simultaneously
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> None of the IPA commands are responding, and I see this error
>>>>>>>>>
>>>>>>>>> ipa user-find p-testipa
>>>>>>>>> ipa: ERROR: Insufficient access: SASL(-1): generic failure: GSSAPI
>>>>>>>>> Error: Unspecified GSS failure. Minor code may provide more information
>>>>>>>>> (KDC returned error string: PROCESS_TGS)
>>>>>>>>>
>>>>>>>>> KRB5_TRACE=/dev/stdout kinit admin
>>>>>>>>> [41178] 1472984115.233214: Getting initial credentials for
>>>>>>>>> <admin at XYZ.COM>admin at XYZ.COM
>>>>>>>>> [41178] 1472984115.235257: Sending request (167 bytes) to XYZ.COM
>>>>>>>>> [41178] 1472984115.235419: Initiating TCP connection to stream
>>>>>>>>> 10.1.3.36:88
>>>>>>>>> [41178] 1472984115.235685: Sending TCP request to stream
>>>>>>>>> 10.1.3.36:88
>>>>>>>>> [41178] 1472984120.238914: Received answer (174 bytes) from stream
>>>>>>>>> 10.1.3.36:88
>>>>>>>>> [41178] 1472984120.238925: Terminating TCP connection to stream
>>>>>>>>> 10.1.3.36:88
>>>>>>>>> [41178] 1472984120.238993: Response was from master KDC
>>>>>>>>> [41
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> Running an ldapsearch to see the db.. does not give any results
>>>>>>>>> and just hangs there
>>>>>>>>>
>>>>>>>>> ldapsearch -x -D 'cn=Directory Manager' -W -s one -b
>>>>>>>>> 'cn=kerberos,dc=xyz,dc=com'
>>>>>>>>> Enter LDAP Password:
>>>>>>>>>
>>>>>>>>> even an ldapsearch -x does not respond
>>>>>>>>> At this point, am sure that slapd is the one causing issues
>>>>>>>>>
>>>>>>>>> Running an strace against the hung slapd itself seems to get stuck
>>>>>>>>> does not proceed after saying "attaching to process"
>>>>>>>>>
>>>>>>>>> From some others posts I read Thierry suggesting to increase the
>>>>>>>>> nsslapd-threadnumber value
>>>>>>>>>
>>>>>>>>> It was set to 30, I think that might be too low.
>>>>>>>>>
>>>>>>>> ...
>>>>>>
>>>>>> [Message clipped]
>>>>>
>>>>>
>>>>>
>>>>
>>>>
>>>> --
>>>> Red Hat GmbH, http://www.de.redhat.com/, Registered seat: Grasbrunn,
>>>> Commercial register: Amtsgericht Muenchen, HRB 153243,
>>>> Managing Directors: Charles Cachera, Michael Cunningham, Michael O'Neill, Eric Shander
>>>>
>>>>
>>>
>>
>>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://listman.redhat.com/archives/freeipa-users/attachments/20160916/24aa2e3b/attachment.htm>
More information about the Freeipa-users
mailing list