<html> <head> <meta content="text/html; charset=ISO-8859-1" http-equiv="Content-Type"> </head> <body bgcolor="#FFFFFF" text="#000000"> <div class="moz-cite-prefix">Hi, If it hangs again, could you get a pstack of the slapd process And also dump the db info 'db_stat -h /var/lib/dirsrv/slapd-<INST>/db -N -CA'. This would help to know which thread holds the lock that that blocks those operations ? thanks thierry On 09/18/2015 09:20 PM, HECTOR LOPEZ wrote: </div> <blockquote cite="mid:CAF3C5=Yh7tasAB2w73SRApVn9zQi5rUcT01qh_QQ3GaTKY-qLQ@mail.gmail.com" type="cite"> <div dir="ltr"> <div dir="ltr" style="font-size:12.8px"> <table class="" style="font-size:12.8px" cellpadding="0"> <tbody> <tr class=""> <td class="" style="width:646px"> <table class="" style="width:646px" cellpadding="0"> <tbody> <tr> <td> <h3 class="">Ludwig Krispenz,</h3> </td> </tr> </tbody> </table> </td> </tr> </tbody> </table> This is the output of gstack on ns-slapd (pstack on rhel), also killing the ns-slapd proces gave this error "ipa: ERROR: cannot connect to 'ldapi://%2fvar%2frun%2fslapd-GSEIS-UCLA-EDU.socket': " After that I could use ipactl restart and the command runs successfully. Thank you for helping me. Again, here is the pstack output of ns-slapd: -sh-4.2$ sudo gstack 2197 Thread 45 (Thread 0x7f3ad8144700 (LWP 2651)): #0 0x00007f3ae74028f3 in select () from /lib64/libc.so.6 #1 0x00007f3ae997d459 in DS_Sleep () from /usr/lib64/dirsrv/libslapd.so.0 #2 0x00007f3adc11e4a7 in deadlock_threadmain () from /usr/lib64/dirsrv/plugins/libback-ldbm.so #3 0x00007f3ae7d3c7bb in _pt_root () from /lib64/libnspr4.so #4 0x00007f3ae76dddf5 in start_thread () from /lib64/libpthread.so.0 #5 0x00007f3ae740b1ad in clone () from /lib64/libc.so.6 Thread 44 (Thread 0x7f3ad7943700 (LWP 2652)): #0 0x00007f3ae74028f3 in select () from /lib64/libc.so.6 #1 0x00007f3ae997d459 in DS_Sleep () from /usr/lib64/dirsrv/libslapd.so.0 #2 0x00007f3adc122576 in checkpoint_threadmain () from /usr/lib64/dirsrv/plugins/libback-ldbm.so #3 0x00007f3ae7d3c7bb in _pt_root () from /lib64/libnspr4.so #4 0x00007f3ae76dddf5 in start_thread () from /lib64/libpthread.so.0 #5 0x00007f3ae740b1ad in clone () from /lib64/libc.so.6 Thread 43 (Thread 0x7f3ad7142700 (LWP 2653)): #0 0x00007f3ae74028f3 in select () from /lib64/libc.so.6 #1 0x00007f3ae997d459 in DS_Sleep () from /usr/lib64/dirsrv/libslapd.so.0 #2 0x00007f3adc11e71f in trickle_threadmain () from /usr/lib64/dirsrv/plugins/libback-ldbm.so #3 0x00007f3ae7d3c7bb in _pt_root () from /lib64/libnspr4.so #4 0x00007f3ae76dddf5 in start_thread () from /lib64/libpthread.so.0 #5 0x00007f3ae740b1ad in clone () from /lib64/libc.so.6 Thread 42 (Thread 0x7f3ad6941700 (LWP 2654)): #0 0x00007f3ae74028f3 in select () from /lib64/libc.so.6 #1 0x00007f3ae997d459 in DS_Sleep () from /usr/lib64/dirsrv/libslapd.so.0 #2 0x00007f3adc119437 in perf_threadmain () from /usr/lib64/dirsrv/plugins/libback-ldbm.so #3 0x00007f3ae7d3c7bb in _pt_root () from /lib64/libnspr4.so #4 0x00007f3ae76dddf5 in start_thread () from /lib64/libpthread.so.0 #5 0x00007f3ae740b1ad in clone () from /lib64/libc.so.6 Thread 41 (Thread 0x7f3ad6140700 (LWP 2655)): #0 0x00007f3ae76e1705 in <a class="moz-txt-link-abbreviated" href="mailto:pthread_cond_wait@@GLIBC_2.3.2">pthread_cond_wait@@GLIBC_2.3.2</a> () from /lib64/libpthread.so.0 #1 0x00007f3ae7d37050 in PR_WaitCondVar () from /lib64/libnspr4.so #2 0x00007f3ae996d438 in slapi_wait_condvar () from /usr/lib64/dirsrv/libslapd.so.0 #3 0x00007f3ae058164e in cos_cache_wait_on_change () from /usr/lib64/dirsrv/plugins/libcos-plugin.so #4 0x00007f3ae7d3c7bb in _pt_root () from /lib64/libnspr4.so #5 0x00007f3ae76dddf5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f3ae740b1ad in clone () from /lib64/libc.so.6 Thread 40 (Thread 0x7f3ad593f700 (LWP 2656)): #0 0x00007f3ae7400b7d in poll () from /lib64/libc.so.6 #1 0x00007f3addf0247c in ipa_cldap_worker () from /usr/lib64/dirsrv/plugins/libipa_cldap.so #2 0x00007f3ae76dddf5 in start_thread () from /lib64/libpthread.so.0 #3 0x00007f3ae740b1ad in clone () from /lib64/libc.so.6 Thread 39 (Thread 0x7f3ad513e700 (LWP 2657)): #0 0x00007f3ae76e1705 in <a class="moz-txt-link-abbreviated" href="mailto:pthread_cond_wait@@GLIBC_2.3.2">pthread_cond_wait@@GLIBC_2.3.2</a> () from /lib64/libpthread.so.0 #1 0x00007f3ae7d37050 in PR_WaitCondVar () from /lib64/libnspr4.so #2 0x00007f3ae996d438 in slapi_wait_condvar () from /usr/lib64/dirsrv/libslapd.so.0 #3 0x00007f3ada7c0edd in roles_cache_wait_on_change () from /usr/lib64/dirsrv/plugins/libroles-plugin.so #4 0x00007f3ae7d3c7bb in _pt_root () from /lib64/libnspr4.so #5 0x00007f3ae76dddf5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f3ae740b1ad in clone () from /lib64/libc.so.6 Thread 38 (Thread 0x7f3ad493d700 (LWP 2658)): #0 0x00007f3ae76e1705 in <a class="moz-txt-link-abbreviated" href="mailto:pthread_cond_wait@@GLIBC_2.3.2">pthread_cond_wait@@GLIBC_2.3.2</a> () from /lib64/libpthread.so.0 #1 0x00007f3ae7d37050 in PR_WaitCondVar () from /lib64/libnspr4.so #2 0x00007f3ae996d438 in slapi_wait_condvar () from /usr/lib64/dirsrv/libslapd.so.0 #3 0x00007f3ada7c0edd in roles_cache_wait_on_change () from /usr/lib64/dirsrv/plugins/libroles-plugin.so #4 0x00007f3ae7d3c7bb in _pt_root () from /lib64/libnspr4.so #5 0x00007f3ae76dddf5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f3ae740b1ad in clone () from /lib64/libc.so.6 Thread 37 (Thread 0x7f3acffff700 (LWP 2659)): #0 0x00007f3ae76e1705 in <a class="moz-txt-link-abbreviated" href="mailto:pthread_cond_wait@@GLIBC_2.3.2">pthread_cond_wait@@GLIBC_2.3.2</a> () from /lib64/libpthread.so.0 #1 0x00007f3ae7d37050 in PR_WaitCondVar () from /lib64/libnspr4.so #2 0x00007f3ae996d438 in slapi_wait_condvar () from /usr/lib64/dirsrv/libslapd.so.0 #3 0x00007f3ada7c0edd in roles_cache_wait_on_change () from /usr/lib64/dirsrv/plugins/libroles-plugin.so #4 0x00007f3ae7d3c7bb in _pt_root () from /lib64/libnspr4.so #5 0x00007f3ae76dddf5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f3ae740b1ad in clone () from /lib64/libc.so.6 Thread 36 (Thread 0x7f3acf7fe700 (LWP 2660)): #0 0x00007f3ae76e1ab2 in <a class="moz-txt-link-abbreviated" href="mailto:pthread_cond_timedwait@@GLIBC_2.3.2">pthread_cond_timedwait@@GLIBC_2.3.2</a> () from /lib64/libpthread.so.0 #1 0x00007f3ae7d36b07 in pt_TimedWait () from /lib64/libnspr4.so #2 0x00007f3ae7d36fce in PR_WaitCondVar () from /lib64/libnspr4.so #3 0x00007f3ae9e21a93 in housecleaning () #4 0x00007f3ae7d3c7bb in _pt_root () from /lib64/libnspr4.so #5 0x00007f3ae76dddf5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f3ae740b1ad in clone () from /lib64/libc.so.6 Thread 35 (Thread 0x7f3aceffd700 (LWP 2661)): #0 0x00007f3ae76e1ab2 in <a class="moz-txt-link-abbreviated" href="mailto:pthread_cond_timedwait@@GLIBC_2.3.2">pthread_cond_timedwait@@GLIBC_2.3.2</a> () from /lib64/libpthread.so.0 #1 0x00007f3ae7d36b07 in pt_TimedWait () from /lib64/libnspr4.so #2 0x00007f3ae7d36fce in PR_WaitCondVar () from /lib64/libnspr4.so #3 0x00007f3ae9914188 in eq_loop () from /usr/lib64/dirsrv/libslapd.so.0 #4 0x00007f3ae7d3c7bb in _pt_root () from /lib64/libnspr4.so #5 0x00007f3ae76dddf5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f3ae740b1ad in clone () from /lib64/libc.so.6 Thread 34 (Thread 0x7f3ace55b700 (LWP 2663)): #0 0x00007f3ae76e1705 in <a class="moz-txt-link-abbreviated" href="mailto:pthread_cond_wait@@GLIBC_2.3.2">pthread_cond_wait@@GLIBC_2.3.2</a> () from /lib64/libpthread.so.0 #1 0x00007f3ae7d37050 in PR_WaitCondVar () from /lib64/libnspr4.so #2 0x00007f3ae9e1865e in connection_wait_for_new_work () #3 0x00007f3ae9e1988d in connection_threadmain () #4 0x00007f3ae7d3c7bb in _pt_root () from /lib64/libnspr4.so #5 0x00007f3ae76dddf5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f3ae740b1ad in clone () from /lib64/libc.so.6 Thread 33 (Thread 0x7f3acdd5a700 (LWP 2664)): #0 0x00007f3ae76e1705 in <a class="moz-txt-link-abbreviated" href="mailto:pthread_cond_wait@@GLIBC_2.3.2">pthread_cond_wait@@GLIBC_2.3.2</a> () from /lib64/libpthread.so.0 #1 0x00007f3ae7d37050 in PR_WaitCondVar () from /lib64/libnspr4.so #2 0x00007f3ae9e1865e in connection_wait_for_new_work () #3 0x00007f3ae9e1988d in connection_threadmain () #4 0x00007f3ae7d3c7bb in _pt_root () from /lib64/libnspr4.so #5 0x00007f3ae76dddf5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f3ae740b1ad in clone () from /lib64/libc.so.6 Thread 32 (Thread 0x7f3acd559700 (LWP 2665)): #0 0x00007f3ae76e1705 in <a class="moz-txt-link-abbreviated" href="mailto:pthread_cond_wait@@GLIBC_2.3.2">pthread_cond_wait@@GLIBC_2.3.2</a> () from /lib64/libpthread.so.0 #1 0x00007f3ae22ae2f3 in __db_hybrid_mutex_suspend () from /lib64/<a moz-do-not-send="true" href="http://libdb-5.3.so/" target="_blank">libdb-5.3.so</a> #2 0x00007f3ae22ad640 in __db_tas_mutex_lock () from /lib64/<a moz-do-not-send="true" href="http://libdb-5.3.so/" target="_blank">libdb-5.3.so</a> #3 0x00007f3ae2357cea in __lock_get_internal () from /lib64/<a moz-do-not-send="true" href="http://libdb-5.3.so/" target="_blank">libdb-5.3.so</a> #4 0x00007f3ae23587d0 in __lock_get () from /lib64/<a moz-do-not-send="true" href="http://libdb-5.3.so/" target="_blank">libdb-5.3.so</a> #5 0x00007f3ae2384112 in __db_lget () from /lib64/<a moz-do-not-send="true" href="http://libdb-5.3.so/" target="_blank">libdb-5.3.so</a> #6 0x00007f3ae22cb5f5 in __bam_search () from /lib64/<a moz-do-not-send="true" href="http://libdb-5.3.so/" target="_blank">libdb-5.3.so</a> #7 0x00007f3ae22b6256 in __bamc_search () from /lib64/<a moz-do-not-send="true" href="http://libdb-5.3.so/" target="_blank">libdb-5.3.so</a> #8 0x00007f3ae22b7d0f in __bamc_get () from /lib64/<a moz-do-not-send="true" href="http://libdb-5.3.so/" target="_blank">libdb-5.3.so</a> #9 0x00007f3ae2370c56 in __dbc_iget () from /lib64/<a moz-do-not-send="true" href="http://libdb-5.3.so/" target="_blank">libdb-5.3.so</a> #10 0x00007f3ae237fad2 in __dbc_get_pp () from /lib64/<a moz-do-not-send="true" href="http://libdb-5.3.so/" target="_blank">libdb-5.3.so</a> #11 0x00007f3adc12d180 in idl_new_fetch () from /usr/lib64/dirsrv/plugins/libback-ldbm.so #12 0x00007f3adc13b5e6 in index_read_ext_allids () from /usr/lib64/dirsrv/plugins/libback-ldbm.so #13 0x00007f3adc125dd4 in keys2idl () from /usr/lib64/dirsrv/plugins/libback-ldbm.so #14 0x00007f3adc126533 in ava_candidates.isra.0 () from /usr/lib64/dirsrv/plugins/libback-ldbm.so #15 0x00007f3adc126b22 in filter_candidates_ext () from /usr/lib64/dirsrv/plugins/libback-ldbm.so #16 0x00007f3adc127b96 in list_candidates () from /usr/lib64/dirsrv/plugins/libback-ldbm.so #17 0x00007f3adc126a90 in filter_candidates_ext () from /usr/lib64/dirsrv/plugins/libback-ldbm.so #18 0x00007f3adc127b96 in list_candidates () from /usr/lib64/dirsrv/plugins/libback-ldbm.so #19 0x00007f3adc126a90 in filter_candidates_ext () from /usr/lib64/dirsrv/plugins/libback-ldbm.so #20 0x00007f3adc127b96 in list_candidates () from /usr/lib64/dirsrv/plugins/libback-ldbm.so #21 0x00007f3adc126a90 in filter_candidates_ext () from /usr/lib64/dirsrv/plugins/libback-ldbm.so #22 0x00007f3adc161fdc in subtree_candidates () from /usr/lib64/dirsrv/plugins/libback-ldbm.so #23 0x00007f3adc1635f7 in ldbm_back_search () from /usr/lib64/dirsrv/plugins/libback-ldbm.so #24 0x00007f3ae993fd49 in op_shared_search () from /usr/lib64/dirsrv/libslapd.so.0 #25 0x00007f3ae9e2b07e in do_search () #26 0x00007f3ae9e1a405 in connection_threadmain () #27 0x00007f3ae7d3c7bb in _pt_root () from /lib64/libnspr4.so #28 0x00007f3ae76dddf5 in start_thread () from /lib64/libpthread.so.0 #29 0x00007f3ae740b1ad in clone () from /lib64/libc.so.6 Thread 31 (Thread 0x7f3accd58700 (LWP 2666)): #0 0x00007f3ae76e1705 in <a class="moz-txt-link-abbreviated" href="mailto:pthread_cond_wait@@GLIBC_2.3.2">pthread_cond_wait@@GLIBC_2.3.2</a> () from /lib64/libpthread.so.0 #1 0x00007f3ae22ae2f3 in __db_hybrid_mutex_suspend () from /lib64/<a moz-do-not-send="true" href="http://libdb-5.3.so/" target="_blank">libdb-5.3.so</a> #2 0x00007f3ae22ad640 in __db_tas_mutex_lock () from /lib64/<a moz-do-not-send="true" href="http://libdb-5.3.so/" target="_blank">libdb-5.3.so</a> #3 0x00007f3ae2357cea in __lock_get_internal () from /lib64/<a moz-do-not-send="true" href="http://libdb-5.3.so/" target="_blank">libdb-5.3.so</a> #4 0x00007f3ae23587d0 in __lock_get () from /lib64/<a moz-do-not-send="true" href="http://libdb-5.3.so/" target="_blank">libdb-5.3.so</a> #5 0x00007f3ae2384112 in __db_lget () from /lib64/<a moz-do-not-send="true" href="http://libdb-5.3.so/" target="_blank">libdb-5.3.so</a> #6 0x00007f3ae22cb5f5 in __bam_search () from /lib64/<a moz-do-not-send="true" href="http://libdb-5.3.so/" target="_blank">libdb-5.3.so</a> #7 0x00007f3ae22b6256 in __bamc_search () from /lib64/<a moz-do-not-send="true" href="http://libdb-5.3.so/" target="_blank">libdb-5.3.so</a> #8 0x00007f3ae22b7d0f in __bamc_get () from /lib64/<a moz-do-not-send="true" href="http://libdb-5.3.so/" target="_blank">libdb-5.3.so</a> #9 0x00007f3ae2370c56 in __dbc_iget () from /lib64/<a moz-do-not-send="true" href="http://libdb-5.3.so/" target="_blank">libdb-5.3.so</a> #10 0x00007f3ae237fad2 in __dbc_get_pp () from /lib64/<a moz-do-not-send="true" href="http://libdb-5.3.so/" target="_blank">libdb-5.3.so</a> #11 0x00007f3adc12d180 in idl_new_fetch () from /usr/lib64/dirsrv/plugins/libback-ldbm.so #12 0x00007f3adc13b5e6 in index_read_ext_allids () from /usr/lib64/dirsrv/plugins/libback-ldbm.so #13 0x00007f3adc125dd4 in keys2idl () from /usr/lib64/dirsrv/plugins/libback-ldbm.so #14 0x00007f3adc126533 in ava_candidates.isra.0 () from /usr/lib64/dirsrv/plugins/libback-ldbm.so #15 0x00007f3adc126b22 in filter_candidates_ext () from /usr/lib64/dirsrv/plugins/libback-ldbm.so #16 0x00007f3adc127b96 in list_candidates () from /usr/lib64/dirsrv/plugins/libback-ldbm.so #17 0x00007f3adc126a90 in filter_candidates_ext () from /usr/lib64/dirsrv/plugins/libback-ldbm.so #18 0x00007f3adc127b96 in list_candidates () from /usr/lib64/dirsrv/plugins/libback-ldbm.so #19 0x00007f3adc126a90 in filter_candidates_ext () from /usr/lib64/dirsrv/plugins/libback-ldbm.so #20 0x00007f3adc127b96 in list_candidates () from /usr/lib64/dirsrv/plugins/libback-ldbm.so #21 0x00007f3adc126a90 in filter_candidates_ext () from /usr/lib64/dirsrv/plugins/libback-ldbm.so #22 0x00007f3adc161fdc in subtree_candidates () from /usr/lib64/dirsrv/plugins/libback-ldbm.so #23 0x00007f3adc1635f7 in ldbm_back_search () from /usr/lib64/dirsrv/plugins/libback-ldbm.so #24 0x00007f3ae993fd49 in op_shared_search () from /usr/lib64/dirsrv/libslapd.so.0 #25 0x00007f3ae9e2b07e in do_search () #26 0x00007f3ae9e1a405 in connection_threadmain () #27 0x00007f3ae7d3c7bb in _pt_root () from /lib64/libnspr4.so #28 0x00007f3ae76dddf5 in start_thread () from /lib64/libpthread.so.0 #29 0x00007f3ae740b1ad in clone () from /lib64/libc.so.6 Thread 30 (Thread 0x7f3ac3fff700 (LWP 2667)): #0 0x00007f3ae76e1705 in <a class="moz-txt-link-abbreviated" href="mailto:pthread_cond_wait@@GLIBC_2.3.2">pthread_cond_wait@@GLIBC_2.3.2</a> () from /lib64/libpthread.so.0 #1 0x00007f3ae22ae2f3 in __db_hybrid_mutex_suspend () from /lib64/<a moz-do-not-send="true" href="http://libdb-5.3.so/" target="_blank">libdb-5.3.so</a> #2 0x00007f3ae22ad640 in __db_tas_mutex_lock () from /lib64/<a moz-do-not-send="true" href="http://libdb-5.3.so/" target="_blank">libdb-5.3.so</a> #3 0x00007f3ae2357cea in __lock_get_internal () from /lib64/<a moz-do-not-send="true" href="http://libdb-5.3.so/" target="_blank">libdb-5.3.so</a> #4 0x00007f3ae23587d0 in __lock_get () from /lib64/<a moz-do-not-send="true" href="http://libdb-5.3.so/" target="_blank">libdb-5.3.so</a> #5 0x00007f3ae2384112 in __db_lget () from /lib64/<a moz-do-not-send="true" href="http://libdb-5.3.so/" target="_blank">libdb-5.3.so</a> #6 0x00007f3ae22cb5f5 in __bam_search () from /lib64/<a moz-do-not-send="true" href="http://libdb-5.3.so/" target="_blank">libdb-5.3.so</a> #7 0x00007f3ae22b6256 in __bamc_search () from /lib64/<a moz-do-not-send="true" href="http://libdb-5.3.so/" target="_blank">libdb-5.3.so</a> #8 0x00007f3ae22b7d0f in __bamc_get () from /lib64/<a moz-do-not-send="true" href="http://libdb-5.3.so/" target="_blank">libdb-5.3.so</a> #9 0x00007f3ae2370c56 in __dbc_iget () from /lib64/<a moz-do-not-send="true" href="http://libdb-5.3.so/" target="_blank">libdb-5.3.so</a> #10 0x00007f3ae237fad2 in __dbc_get_pp () from /lib64/<a moz-do-not-send="true" href="http://libdb-5.3.so/" target="_blank">libdb-5.3.so</a> #11 0x00007f3adc12d180 in idl_new_fetch () from /usr/lib64/dirsrv/plugins/libback-ldbm.so #12 0x00007f3adc13b5e6 in index_read_ext_allids () from /usr/lib64/dirsrv/plugins/libback-ldbm.so #13 0x00007f3adc125dd4 in keys2idl () from /usr/lib64/dirsrv/plugins/libback-ldbm.so #14 0x00007f3adc126533 in ava_candidates.isra.0 () from /usr/lib64/dirsrv/plugins/libback-ldbm.so #15 0x00007f3adc126b22 in filter_candidates_ext () from /usr/lib64/dirsrv/plugins/libback-ldbm.so #16 0x00007f3adc127b96 in list_candidates () from /usr/lib64/dirsrv/plugins/libback-ldbm.so #17 0x00007f3adc126a90 in filter_candidates_ext () from /usr/lib64/dirsrv/plugins/libback-ldbm.so #18 0x00007f3adc161fdc in subtree_candidates () from /usr/lib64/dirsrv/plugins/libback-ldbm.so #19 0x00007f3adc1635f7 in ldbm_back_search () from /usr/lib64/dirsrv/plugins/libback-ldbm.so #20 0x00007f3ae993fd49 in op_shared_search () from /usr/lib64/dirsrv/libslapd.so.0 #21 0x00007f3ae99501de in search_internal_callback_pb () from /usr/lib64/dirsrv/libslapd.so.0 #22 0x00007f3ae9950478 in search_internal_pb () from /usr/lib64/dirsrv/libslapd.so.0 #23 0x00007f3ae9e291fb in ids_sasl_canon_user () #24 0x00007f3ae7afd93b in _sasl_canon_user () from /lib64/libsasl2.so.3 #25 0x00007f3ae7afdc4c in _sasl_canon_user_lookup () from /lib64/libsasl2.so.3 #26 0x00007f3ae1c226de in crammd5_server_mech_step2.isra.6 () from /usr/lib64/sasl2/libcrammd5.so #27 0x00007f3ae1c22ad9 in crammd5_server_mech_step () from /usr/lib64/sasl2/libcrammd5.so #28 0x00007f3ae7b09b88 in sasl_server_step () from /lib64/libsasl2.so.3 #29 0x00007f3ae9e2a576 in ids_sasl_check_bind () #30 0x00007f3ae9e13b22 in do_bind () #31 0x00007f3ae9e1a43f in connection_threadmain () #32 0x00007f3ae7d3c7bb in _pt_root () from /lib64/libnspr4.so #33 0x00007f3ae76dddf5 in start_thread () from /lib64/libpthread.so.0 #34 0x00007f3ae740b1ad in clone () from /lib64/libc.so.6 Thread 29 (Thread 0x7f3ac37fe700 (LWP 2668)): #0 0x00007f3ae76e1705 in <a class="moz-txt-link-abbreviated" href="mailto:pthread_cond_wait@@GLIBC_2.3.2">pthread_cond_wait@@GLIBC_2.3.2</a> () from /lib64/libpthread.so.0 #1 0x00007f3ae22ae2f3 in __db_hybrid_mutex_suspend () from /lib64/<a moz-do-not-send="true" href="http://libdb-5.3.so/" target="_blank">libdb-5.3.so</a> #2 0x00007f3ae22ad640 in __db_tas_mutex_lock () from /lib64/<a moz-do-not-send="true" href="http://libdb-5.3.so/" target="_blank">libdb-5.3.so</a> #3 0x00007f3ae2357cea in __lock_get_internal () from /lib64/<a moz-do-not-send="true" href="http://libdb-5.3.so/" target="_blank">libdb-5.3.so</a> #4 0x00007f3ae23587d0 in __lock_get () from /lib64/<a moz-do-not-send="true" href="http://libdb-5.3.so/" target="_blank">libdb-5.3.so</a> #5 0x00007f3ae2384112 in __db_lget () from /lib64/<a moz-do-not-send="true" href="http://libdb-5.3.so/" target="_blank">libdb-5.3.so</a> #6 0x00007f3ae22cb5f5 in __bam_search () from /lib64/<a moz-do-not-send="true" href="http://libdb-5.3.so/" target="_blank">libdb-5.3.so</a> #7 0x00007f3ae22b6256 in __bamc_search () from /lib64/<a moz-do-not-send="true" href="http://libdb-5.3.so/" target="_blank">libdb-5.3.so</a> #8 0x00007f3ae22b7d0f in __bamc_get () from /lib64/<a moz-do-not-send="true" href="http://libdb-5.3.so/" target="_blank">libdb-5.3.so</a> #9 0x00007f3ae2370c56 in __dbc_iget () from /lib64/<a moz-do-not-send="true" href="http://libdb-5.3.so/" target="_blank">libdb-5.3.so</a> #10 0x00007f3ae237fad2 in __dbc_get_pp () from /lib64/<a moz-do-not-send="true" href="http://libdb-5.3.so/" target="_blank">libdb-5.3.so</a> #11 0x00007f3adc12d180 in idl_new_fetch () from /usr/lib64/dirsrv/plugins/libback-ldbm.so #12 0x00007f3adc13b5e6 in index_read_ext_allids () from /usr/lib64/dirsrv/plugins/libback-ldbm.so #13 0x00007f3adc125dd4 in keys2idl () from /usr/lib64/dirsrv/plugins/libback-ldbm.so #14 0x00007f3adc126533 in ava_candidates.isra.0 () from /usr/lib64/dirsrv/plugins/libback-ldbm.so #15 0x00007f3adc126b22 in filter_candidates_ext () from /usr/lib64/dirsrv/plugins/libback-ldbm.so #16 0x00007f3adc127b96 in list_candidates () from /usr/lib64/dirsrv/plugins/libback-ldbm.so #17 0x00007f3adc126a90 in filter_candidates_ext () from /usr/lib64/dirsrv/plugins/libback-ldbm.so #18 0x00007f3adc127b96 in list_candidates () from /usr/lib64/dirsrv/plugins/libback-ldbm.so #19 0x00007f3adc126a90 in filter_candidates_ext () from /usr/lib64/dirsrv/plugins/libback-ldbm.so #20 0x00007f3adc127b96 in list_candidates () from /usr/lib64/dirsrv/plugins/libback-ldbm.so #21 0x00007f3adc126a90 in filter_candidates_ext () from /usr/lib64/dirsrv/plugins/libback-ldbm.so #22 0x00007f3adc161fdc in subtree_candidates () from /usr/lib64/dirsrv/plugins/libback-ldbm.so #23 0x00007f3adc1635f7 in ldbm_back_search () from /usr/lib64/dirsrv/plugins/libback-ldbm.so #24 0x00007f3ae993fd49 in op_shared_search () from /usr/lib64/dirsrv/libslapd.so.0 #25 0x00007f3ae9e2b07e in do_search () #26 0x00007f3ae9e1a405 in connection_threadmain () #27 0x00007f3ae7d3c7bb in _pt_root () from /lib64/libnspr4.so #28 0x00007f3ae76dddf5 in start_thread () from /lib64/libpthread.so.0 #29 0x00007f3ae740b1ad in clone () from /lib64/libc.so.6 Thread 28 (Thread 0x7f3ac2ffd700 (LWP 2669)): #0 0x00007f3ae76e1705 in <a class="moz-txt-link-abbreviated" href="mailto:pthread_cond_wait@@GLIBC_2.3.2">pthread_cond_wait@@GLIBC_2.3.2</a> () from /lib64/libpthread.so.0 #1 0x00007f3ae7d37050 in PR_WaitCondVar () from /lib64/libnspr4.so #2 0x00007f3ae9e1865e in connection_wait_for_new_work () #3 0x00007f3ae9e1988d in connection_threadmain () #4 0x00007f3ae7d3c7bb in _pt_root () from /lib64/libnspr4.so #5 0x00007f3ae76dddf5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f3ae740b1ad in clone () from /lib64/libc.so.6 Thread 27 (Thread 0x7f3ac27fc700 (LWP 2670)): #0 0x00007f3ae76e1705 in <a class="moz-txt-link-abbreviated" href="mailto:pthread_cond_wait@@GLIBC_2.3.2">pthread_cond_wait@@GLIBC_2.3.2</a> () from /lib64/libpthread.so.0 #1 0x00007f3ae7d37050 in PR_WaitCondVar () from /lib64/libnspr4.so #2 0x00007f3ae9e1865e in connection_wait_for_new_work () #3 0x00007f3ae9e1988d in connection_threadmain () #4 0x00007f3ae7d3c7bb in _pt_root () from /lib64/libnspr4.so #5 0x00007f3ae76dddf5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f3ae740b1ad in clone () from /lib64/libc.so.6 Thread 26 (Thread 0x7f3ac1ffb700 (LWP 2671)): #0 0x00007f3ae76e1705 in <a class="moz-txt-link-abbreviated" href="mailto:pthread_cond_wait@@GLIBC_2.3.2">pthread_cond_wait@@GLIBC_2.3.2</a> () from /lib64/libpthread.so.0 #1 0x00007f3ae7d37050 in PR_WaitCondVar () from /lib64/libnspr4.so #2 0x00007f3ae9e1865e in connection_wait_for_new_work () #3 0x00007f3ae9e1988d in connection_threadmain () #4 0x00007f3ae7d3c7bb in _pt_root () from /lib64/libnspr4.so #5 0x00007f3ae76dddf5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f3ae740b1ad in clone () from /lib64/libc.so.6 Thread 25 (Thread 0x7f3ac17fa700 (LWP 2672)): #0 0x00007f3ae76e1705 in <a class="moz-txt-link-abbreviated" href="mailto:pthread_cond_wait@@GLIBC_2.3.2">pthread_cond_wait@@GLIBC_2.3.2</a> () from /lib64/libpthread.so.0 #1 0x00007f3ae7d37050 in PR_WaitCondVar () from /lib64/libnspr4.so #2 0x00007f3ae9e1865e in connection_wait_for_new_work () #3 0x00007f3ae9e1988d in connection_threadmain () #4 0x00007f3ae7d3c7bb in _pt_root () from /lib64/libnspr4.so #5 0x00007f3ae76dddf5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f3ae740b1ad in clone () from /lib64/libc.so.6 Thread 24 (Thread 0x7f3ac0ff9700 (LWP 2673)): #0 0x00007f3ae76e1705 in <a class="moz-txt-link-abbreviated" href="mailto:pthread_cond_wait@@GLIBC_2.3.2">pthread_cond_wait@@GLIBC_2.3.2</a> () from /lib64/libpthread.so.0 #1 0x00007f3ae7d37050 in PR_WaitCondVar () from /lib64/libnspr4.so #2 0x00007f3ae9e1865e in connection_wait_for_new_work () #3 0x00007f3ae9e1988d in connection_threadmain () #4 0x00007f3ae7d3c7bb in _pt_root () from /lib64/libnspr4.so #5 0x00007f3ae76dddf5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f3ae740b1ad in clone () from /lib64/libc.so.6 Thread 23 (Thread 0x7f3abbfff700 (LWP 2674)): #0 0x00007f3ae76e1705 in <a class="moz-txt-link-abbreviated" href="mailto:pthread_cond_wait@@GLIBC_2.3.2">pthread_cond_wait@@GLIBC_2.3.2</a> () from /lib64/libpthread.so.0 #1 0x00007f3ae7d37050 in PR_WaitCondVar () from /lib64/libnspr4.so #2 0x00007f3ae9e1865e in connection_wait_for_new_work () #3 0x00007f3ae9e1988d in connection_threadmain () #4 0x00007f3ae7d3c7bb in _pt_root () from /lib64/libnspr4.so #5 0x00007f3ae76dddf5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f3ae740b1ad in clone () from /lib64/libc.so.6 Thread 22 (Thread 0x7f3abb7fe700 (LWP 2675)): #0 0x00007f3ae76e1705 in <a class="moz-txt-link-abbreviated" href="mailto:pthread_cond_wait@@GLIBC_2.3.2">pthread_cond_wait@@GLIBC_2.3.2</a> () from /lib64/libpthread.so.0 #1 0x00007f3ae7d37050 in PR_WaitCondVar () from /lib64/libnspr4.so #2 0x00007f3ae9e1865e in connection_wait_for_new_work () #3 0x00007f3ae9e1988d in connection_threadmain () #4 0x00007f3ae7d3c7bb in _pt_root () from /lib64/libnspr4.so #5 0x00007f3ae76dddf5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f3ae740b1ad in clone () from /lib64/libc.so.6 Thread 21 (Thread 0x7f3abaffd700 (LWP 2676)): #0 0x00007f3ae76e1705 in <a class="moz-txt-link-abbreviated" href="mailto:pthread_cond_wait@@GLIBC_2.3.2">pthread_cond_wait@@GLIBC_2.3.2</a> () from /lib64/libpthread.so.0 #1 0x00007f3ae7d37050 in PR_WaitCondVar () from /lib64/libnspr4.so #2 0x00007f3ae9e1865e in connection_wait_for_new_work () #3 0x00007f3ae9e1988d in connection_threadmain () #4 0x00007f3ae7d3c7bb in _pt_root () from /lib64/libnspr4.so #5 0x00007f3ae76dddf5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f3ae740b1ad in clone () from /lib64/libc.so.6 Thread 20 (Thread 0x7f3aba7fc700 (LWP 2677)): #0 0x00007f3ae76e1705 in <a class="moz-txt-link-abbreviated" href="mailto:pthread_cond_wait@@GLIBC_2.3.2">pthread_cond_wait@@GLIBC_2.3.2</a> () from /lib64/libpthread.so.0 #1 0x00007f3ae7d37050 in PR_WaitCondVar () from /lib64/libnspr4.so #2 0x00007f3ae9e1865e in connection_wait_for_new_work () #3 0x00007f3ae9e1988d in connection_threadmain () #4 0x00007f3ae7d3c7bb in _pt_root () from /lib64/libnspr4.so #5 0x00007f3ae76dddf5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f3ae740b1ad in clone () from /lib64/libc.so.6 Thread 19 (Thread 0x7f3ab9ffb700 (LWP 2678)): #0 0x00007f3ae76e1705 in <a class="moz-txt-link-abbreviated" href="mailto:pthread_cond_wait@@GLIBC_2.3.2">pthread_cond_wait@@GLIBC_2.3.2</a> () from /lib64/libpthread.so.0 #1 0x00007f3ae7d37050 in PR_WaitCondVar () from /lib64/libnspr4.so #2 0x00007f3ae9e1865e in connection_wait_for_new_work () #3 0x00007f3ae9e1988d in connection_threadmain () #4 0x00007f3ae7d3c7bb in _pt_root () from /lib64/libnspr4.so #5 0x00007f3ae76dddf5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f3ae740b1ad in clone () from /lib64/libc.so.6 Thread 18 (Thread 0x7f3ab97fa700 (LWP 2679)): #0 0x00007f3ae76e1705 in <a class="moz-txt-link-abbreviated" href="mailto:pthread_cond_wait@@GLIBC_2.3.2">pthread_cond_wait@@GLIBC_2.3.2</a> () from /lib64/libpthread.so.0 #1 0x00007f3ae7d37050 in PR_WaitCondVar () from /lib64/libnspr4.so #2 0x00007f3ae9e1865e in connection_wait_for_new_work () #3 0x00007f3ae9e1988d in connection_threadmain () #4 0x00007f3ae7d3c7bb in _pt_root () from /lib64/libnspr4.so #5 0x00007f3ae76dddf5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f3ae740b1ad in clone () from /lib64/libc.so.6 Thread 17 (Thread 0x7f3ab8ff9700 (LWP 2680)): #0 0x00007f3ae76e1705 in <a class="moz-txt-link-abbreviated" href="mailto:pthread_cond_wait@@GLIBC_2.3.2">pthread_cond_wait@@GLIBC_2.3.2</a> () from /lib64/libpthread.so.0 #1 0x00007f3ae7d37050 in PR_WaitCondVar () from /lib64/libnspr4.so #2 0x00007f3ae9e1865e in connection_wait_for_new_work () #3 0x00007f3ae9e1988d in connection_threadmain () #4 0x00007f3ae7d3c7bb in _pt_root () from /lib64/libnspr4.so #5 0x00007f3ae76dddf5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f3ae740b1ad in clone () from /lib64/libc.so.6 Thread 16 (Thread 0x7f3ab87f8700 (LWP 2681)): #0 0x00007f3ae76e1705 in <a class="moz-txt-link-abbreviated" href="mailto:pthread_cond_wait@@GLIBC_2.3.2">pthread_cond_wait@@GLIBC_2.3.2</a> () from /lib64/libpthread.so.0 #1 0x00007f3ae7d37050 in PR_WaitCondVar () from /lib64/libnspr4.so #2 0x00007f3ae9e1865e in connection_wait_for_new_work () #3 0x00007f3ae9e1988d in connection_threadmain () #4 0x00007f3ae7d3c7bb in _pt_root () from /lib64/libnspr4.so #5 0x00007f3ae76dddf5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f3ae740b1ad in clone () from /lib64/libc.so.6 Thread 15 (Thread 0x7f3ab7ff7700 (LWP 2682)): #0 0x00007f3ae76e1705 in <a class="moz-txt-link-abbreviated" href="mailto:pthread_cond_wait@@GLIBC_2.3.2">pthread_cond_wait@@GLIBC_2.3.2</a> () from /lib64/libpthread.so.0 #1 0x00007f3ae7d37050 in PR_WaitCondVar () from /lib64/libnspr4.so #2 0x00007f3ae9e1865e in connection_wait_for_new_work () #3 0x00007f3ae9e1988d in connection_threadmain () #4 0x00007f3ae7d3c7bb in _pt_root () from /lib64/libnspr4.so #5 0x00007f3ae76dddf5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f3ae740b1ad in clone () from /lib64/libc.so.6 Thread 14 (Thread 0x7f3ab77f6700 (LWP 2683)): #0 0x00007f3ae76e1705 in <a class="moz-txt-link-abbreviated" href="mailto:pthread_cond_wait@@GLIBC_2.3.2">pthread_cond_wait@@GLIBC_2.3.2</a> () from /lib64/libpthread.so.0 #1 0x00007f3ae7d37050 in PR_WaitCondVar () from /lib64/libnspr4.so #2 0x00007f3ae9e1865e in connection_wait_for_new_work () #3 0x00007f3ae9e1988d in connection_threadmain () #4 0x00007f3ae7d3c7bb in _pt_root () from /lib64/libnspr4.so #5 0x00007f3ae76dddf5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f3ae740b1ad in clone () from /lib64/libc.so.6 Thread 13 (Thread 0x7f3ab6ff5700 (LWP 2684)): #0 0x00007f3ae76e1705 in <a class="moz-txt-link-abbreviated" href="mailto:pthread_cond_wait@@GLIBC_2.3.2">pthread_cond_wait@@GLIBC_2.3.2</a> () from /lib64/libpthread.so.0 #1 0x00007f3ae7d37050 in PR_WaitCondVar () from /lib64/libnspr4.so #2 0x00007f3ae9e1865e in connection_wait_for_new_work () #3 0x00007f3ae9e1988d in connection_threadmain () #4 0x00007f3ae7d3c7bb in _pt_root () from /lib64/libnspr4.so #5 0x00007f3ae76dddf5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f3ae740b1ad in clone () from /lib64/libc.so.6 Thread 12 (Thread 0x7f3ab67f4700 (LWP 2685)): #0 0x00007f3ae76e1705 in <a class="moz-txt-link-abbreviated" href="mailto:pthread_cond_wait@@GLIBC_2.3.2">pthread_cond_wait@@GLIBC_2.3.2</a> () from /lib64/libpthread.so.0 #1 0x00007f3ae7d37050 in PR_WaitCondVar () from /lib64/libnspr4.so #2 0x00007f3ae9e1865e in connection_wait_for_new_work () #3 0x00007f3ae9e1988d in connection_threadmain () #4 0x00007f3ae7d3c7bb in _pt_root () from /lib64/libnspr4.so #5 0x00007f3ae76dddf5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f3ae740b1ad in clone () from /lib64/libc.so.6 Thread 11 (Thread 0x7f3ab5ff3700 (LWP 2686)): #0 0x00007f3ae76e1705 in <a class="moz-txt-link-abbreviated" href="mailto:pthread_cond_wait@@GLIBC_2.3.2">pthread_cond_wait@@GLIBC_2.3.2</a> () from /lib64/libpthread.so.0 #1 0x00007f3ae22ae2f3 in __db_hybrid_mutex_suspend () from /lib64/<a moz-do-not-send="true" href="http://libdb-5.3.so/" target="_blank">libdb-5.3.so</a> #2 0x00007f3ae22ad640 in __db_tas_mutex_lock () from /lib64/<a moz-do-not-send="true" href="http://libdb-5.3.so/" target="_blank">libdb-5.3.so</a> #3 0x00007f3ae2357cea in __lock_get_internal () from /lib64/<a moz-do-not-send="true" href="http://libdb-5.3.so/" target="_blank">libdb-5.3.so</a> #4 0x00007f3ae23587d0 in __lock_get () from /lib64/<a moz-do-not-send="true" href="http://libdb-5.3.so/" target="_blank">libdb-5.3.so</a> #5 0x00007f3ae2384112 in __db_lget () from /lib64/<a moz-do-not-send="true" href="http://libdb-5.3.so/" target="_blank">libdb-5.3.so</a> #6 0x00007f3ae22cb5f5 in __bam_search () from /lib64/<a moz-do-not-send="true" href="http://libdb-5.3.so/" target="_blank">libdb-5.3.so</a> #7 0x00007f3ae22b6256 in __bamc_search () from /lib64/<a moz-do-not-send="true" href="http://libdb-5.3.so/" target="_blank">libdb-5.3.so</a> #8 0x00007f3ae22b7d0f in __bamc_get () from /lib64/<a moz-do-not-send="true" href="http://libdb-5.3.so/" target="_blank">libdb-5.3.so</a> #9 0x00007f3ae2370c56 in __dbc_iget () from /lib64/<a moz-do-not-send="true" href="http://libdb-5.3.so/" target="_blank">libdb-5.3.so</a> #10 0x00007f3ae237d843 in __db_get () from /lib64/<a moz-do-not-send="true" href="http://libdb-5.3.so/" target="_blank">libdb-5.3.so</a> #11 0x00007f3ae2381123 in __db_get_pp () from /lib64/<a moz-do-not-send="true" href="http://libdb-5.3.so/" target="_blank">libdb-5.3.so</a> #12 0x00007f3adc12949b in id2entry () from /usr/lib64/dirsrv/plugins/libback-ldbm.so #13 0x00007f3adc14f7dd in ldbm_back_delete () from /usr/lib64/dirsrv/plugins/libback-ldbm.so #14 0x00007f3ae9900190 in op_shared_delete () from /usr/lib64/dirsrv/libslapd.so.0 #15 0x00007f3ae9900342 in delete_internal_pb () from /usr/lib64/dirsrv/libslapd.so.0 #16 0x00007f3adba44739 in mep_del_post_op () from /usr/lib64/dirsrv/plugins/libmanagedentries-plugin.so #17 0x00007f3ae994c280 in plugin_call_func () from /usr/lib64/dirsrv/libslapd.so.0 #18 0x00007f3ae994c4d8 in plugin_call_plugins () from /usr/lib64/dirsrv/libslapd.so.0 #19 0x00007f3adc14e42e in ldbm_back_delete () from /usr/lib64/dirsrv/plugins/libback-ldbm.so #20 0x00007f3ae9900190 in op_shared_delete () from /usr/lib64/dirsrv/libslapd.so.0 #21 0x00007f3ae9900453 in do_delete () from /usr/lib64/dirsrv/libslapd.so.0 #22 0x00007f3ae9e1a37e in connection_threadmain () #23 0x00007f3ae7d3c7bb in _pt_root () from /lib64/libnspr4.so #24 0x00007f3ae76dddf5 in start_thread () from /lib64/libpthread.so.0 #25 0x00007f3ae740b1ad in clone () from /lib64/libc.so.6 Thread 10 (Thread 0x7f3ab57f2700 (LWP 2687)): #0 0x00007f3ae76e1705 in <a class="moz-txt-link-abbreviated" href="mailto:pthread_cond_wait@@GLIBC_2.3.2">pthread_cond_wait@@GLIBC_2.3.2</a> () from /lib64/libpthread.so.0 #1 0x00007f3ae7d37050 in PR_WaitCondVar () from /lib64/libnspr4.so #2 0x00007f3ae9e1865e in connection_wait_for_new_work () #3 0x00007f3ae9e1988d in connection_threadmain () #4 0x00007f3ae7d3c7bb in _pt_root () from /lib64/libnspr4.so #5 0x00007f3ae76dddf5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f3ae740b1ad in clone () from /lib64/libc.so.6 Thread 9 (Thread 0x7f3ab4ff1700 (LWP 2688)): #0 0x00007f3ae76e1705 in <a class="moz-txt-link-abbreviated" href="mailto:pthread_cond_wait@@GLIBC_2.3.2">pthread_cond_wait@@GLIBC_2.3.2</a> () from /lib64/libpthread.so.0 #1 0x00007f3ae7d37050 in PR_WaitCondVar () from /lib64/libnspr4.so #2 0x00007f3ae9e1865e in connection_wait_for_new_work () #3 0x00007f3ae9e1988d in connection_threadmain () #4 0x00007f3ae7d3c7bb in _pt_root () from /lib64/libnspr4.so #5 0x00007f3ae76dddf5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f3ae740b1ad in clone () from /lib64/libc.so.6 Thread 8 (Thread 0x7f3ab47f0700 (LWP 2689)): #0 0x00007f3ae76e1705 in <a class="moz-txt-link-abbreviated" href="mailto:pthread_cond_wait@@GLIBC_2.3.2">pthread_cond_wait@@GLIBC_2.3.2</a> () from /lib64/libpthread.so.0 #1 0x00007f3ae7d37050 in PR_WaitCondVar () from /lib64/libnspr4.so #2 0x00007f3ae9e1865e in connection_wait_for_new_work () #3 0x00007f3ae9e1988d in connection_threadmain () #4 0x00007f3ae7d3c7bb in _pt_root () from /lib64/libnspr4.so #5 0x00007f3ae76dddf5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f3ae740b1ad in clone () from /lib64/libc.so.6 Thread 7 (Thread 0x7f3ab3fef700 (LWP 2690)): #0 0x00007f3ae76e1705 in <a class="moz-txt-link-abbreviated" href="mailto:pthread_cond_wait@@GLIBC_2.3.2">pthread_cond_wait@@GLIBC_2.3.2</a> () from /lib64/libpthread.so.0 #1 0x00007f3ae7d37050 in PR_WaitCondVar () from /lib64/libnspr4.so #2 0x00007f3ae9e1865e in connection_wait_for_new_work () #3 0x00007f3ae9e1988d in connection_threadmain () #4 0x00007f3ae7d3c7bb in _pt_root () from /lib64/libnspr4.so #5 0x00007f3ae76dddf5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f3ae740b1ad in clone () from /lib64/libc.so.6 Thread 6 (Thread 0x7f3ab37ee700 (LWP 2691)): #0 0x00007f3ae76e1705 in <a class="moz-txt-link-abbreviated" href="mailto:pthread_cond_wait@@GLIBC_2.3.2">pthread_cond_wait@@GLIBC_2.3.2</a> () from /lib64/libpthread.so.0 #1 0x00007f3ae7d37050 in PR_WaitCondVar () from /lib64/libnspr4.so #2 0x00007f3ae9e1865e in connection_wait_for_new_work () #3 0x00007f3ae9e1988d in connection_threadmain () #4 0x00007f3ae7d3c7bb in _pt_root () from /lib64/libnspr4.so #5 0x00007f3ae76dddf5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f3ae740b1ad in clone () from /lib64/libc.so.6 Thread 5 (Thread 0x7f3ab2fed700 (LWP 2692)): #0 0x00007f3ae76e1705 in <a class="moz-txt-link-abbreviated" href="mailto:pthread_cond_wait@@GLIBC_2.3.2">pthread_cond_wait@@GLIBC_2.3.2</a> () from /lib64/libpthread.so.0 #1 0x00007f3ae7d37050 in PR_WaitCondVar () from /lib64/libnspr4.so #2 0x00007f3ae9e1865e in connection_wait_for_new_work () #3 0x00007f3ae9e1988d in connection_threadmain () #4 0x00007f3ae7d3c7bb in _pt_root () from /lib64/libnspr4.so #5 0x00007f3ae76dddf5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f3ae740b1ad in clone () from /lib64/libc.so.6 Thread 4 (Thread 0x7f3ab27ec700 (LWP 2693)): #0 0x00007f3ae74028f3 in select () from /lib64/libc.so.6 #1 0x00007f3ae997d459 in DS_Sleep () from /usr/lib64/dirsrv/libslapd.so.0 #2 0x00007f3ae9e1b2c5 in time_thread () #3 0x00007f3ae7d3c7bb in _pt_root () from /lib64/libnspr4.so #4 0x00007f3ae76dddf5 in start_thread () from /lib64/libpthread.so.0 #5 0x00007f3ae740b1ad in clone () from /lib64/libc.so.6 Thread 3 (Thread 0x7f3ab1feb700 (LWP 2725)): #0 0x00007f3ae76e1ab2 in <a class="moz-txt-link-abbreviated" href="mailto:pthread_cond_timedwait@@GLIBC_2.3.2">pthread_cond_timedwait@@GLIBC_2.3.2</a> () from /lib64/libpthread.so.0 #1 0x00007f3ae7d36b07 in pt_TimedWait () from /lib64/libnspr4.so #2 0x00007f3ae7d36fce in PR_WaitCondVar () from /lib64/libnspr4.so #3 0x00007f3ae0376374 in sync_send_results () from /usr/lib64/dirsrv/plugins/libcontentsync-plugin.so #4 0x00007f3ae7d3c7bb in _pt_root () from /lib64/libnspr4.so #5 0x00007f3ae76dddf5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f3ae740b1ad in clone () from /lib64/libc.so.6 Thread 2 (Thread 0x7f3ab17ea700 (LWP 2967)): #0 0x00007f3ae76e1705 in <a class="moz-txt-link-abbreviated" href="mailto:pthread_cond_wait@@GLIBC_2.3.2">pthread_cond_wait@@GLIBC_2.3.2</a> () from /lib64/libpthread.so.0 #1 0x00007f3ae7d37050 in PR_WaitCondVar () from /lib64/libnspr4.so #2 0x00007f3ae9e25c85 in ps_send_results () #3 0x00007f3ae7d3c7bb in _pt_root () from /lib64/libnspr4.so #4 0x00007f3ae76dddf5 in start_thread () from /lib64/libpthread.so.0 #5 0x00007f3ae740b1ad in clone () from /lib64/libc.so.6 Thread 1 (Thread 0x7f3ae9de2840 (LWP 2197)): #0 0x00007f3ae76e3f7d in __lll_lock_wait () from /lib64/libpthread.so.0 #1 0x00007f3ae76dfd68 in _L_lock_975 () from /lib64/libpthread.so.0 #2 0x00007f3ae76dfd11 in pthread_mutex_lock () from /lib64/libpthread.so.0 #3 0x00007f3ae7d36cb9 in PR_Lock () from /lib64/libnspr4.so #4 0x00007f3ae9e1def6 in slapd_daemon () #5 0x00007f3ae9e1117c in main () -sh-4.2$ </div> <div class="" style="font-size:12.8px"> <div id=":r3" class="" tabindex="0"><img moz-do-not-send="true" class="" src="https://ssl.gstatic.com/ui/v1/icons/mail/images/cleardot.gif"></div> </div> </div> <div class="gmail_extra"> <div class="gmail_quote">On Fri, Sep 18, 2015 at 12:52 AM, Ludwig Krispenz <<a moz-do-not-send="true" href="mailto:lkrispen@redhat.com" target="_blank">lkrispen@redhat.com</a>> wrote: <blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"> <div bgcolor="#FFFFFF" text="#000000"> <div>On 09/18/2015 12:24 AM, HECTOR LOPEZ wrote: </div> <blockquote type="cite"> <div dir="ltr"> <div> <div> <div>This is rhel 7.1 with ipa version 4.1.0 </div> user-show shows the user. However, if the user contains ipaNTSecurityIdentifier: attribute, user-del hangs with no response. </div> Meanwhile, the KDC and 389ds stop working. The only way to recover functionality is to reboot the machine. ipactl restart does nothing. </div> </div> </blockquote> If it hangs again, could you get a pstack of the slapd process ? If you then kill slapd, does ipactl restart work ? <div> <div class="h5"> <blockquote type="cite"> <div dir="ltr"> <div> </div> In the ldap access log I see this when trying to delete user sclown: [14/Sep/2015:09:28:27 -0700] conn=326 op=18 RESULT err=0 tag=101 nentries=0 etime=0 [14/Sep/2015:09:28:27 -0700] conn=326 op=19 DEL dn="uid=sclown,cn=users,cn=accounts,dc=some,dc=domain,dc=org" <div>[14/Sep/2015:09:30:03 -0700] conn=12 op=442 MOD dn="cn=MasterCRL,ou=crlIssuingPoints,ou=ca,o=ipaca" [14/Sep/2015:09:30:03 -0700] conn=12 op=442 RESULT err=1 tag=103 nentries=0 etime=0 [14/Sep/2015:09:30:06 -0700] conn=20 op=288 SRCH base="ou=sessions,ou=Security Domain,o=ipaca" scope=2 filter="(objectClass=securityDomainSessionEntry)" attrs="cn" [14/Sep/2015:09:30:06 -0700] conn=20 op=288 RESULT err=32 tag=101 nentries=0 etime=0 [14/Sep/2015:09:30:08 -0700] conn=12 op=444 SRCH base="ou=certificateRepository,ou=ca,o=ipaca" scope=1 filter="(certStatus=INVALID)" attrs="objectClass serialno notBefore notAfter duration extension subjectName userCertificate version algorithmId signingAlgorithmId publicKeyData" [14/Sep/2015:09:30:08 -0700] conn=12 op=444 SORT notBefore [14/Sep/2015:09:30:08 -0700] conn=12 op=444 VLV 200:0:20150914093009Z 1:0 (0) [14/Sep/2015:09:30:08 -0700] conn=12 op=444 RESULT err=0 tag=101 nentries=0 etime=0 [14/Sep/2015:09:30:08 -0700] conn=12 op=445 SRCH base="ou=certificateRepository,ou=ca,o=ipaca" scope=1 filter="(certStatus=VALID)" attrs="objectClass serialno notBefore notAfter duration extension subjectName userCertificate version algorithmId signingAlgorithmId publicKeyData" [14/Sep/2015:09:30:08 -0700] conn=12 op=445 SORT notAfter [14/Sep/2015:09:30:08 -0700] conn=12 op=445 VLV 200:0:20150914093009Z 1:10 (0) [14/Sep/2015:09:30:08 -0700] conn=12 op=445 RESULT err=0 tag=101 nentries=1 etime=0 [14/Sep/2015:09:30:08 -0700] conn=12 op=446 SRCH base="ou=certificateRepository,ou=ca,o=ipaca" scope=1 filter="(certStatus=REVOKED)" attrs="objectClass revokedOn serialno revInfo notAfter notBefore duration extension subjectName userCertificate version algorithmId signingAlgorithmId publicKeyData" [14/Sep/2015:09:30:08 -0700] conn=12 op=446 VLV 200:0:20150914093009Z 0:0 (0) [14/Sep/2015:09:30:08 -0700] conn=12 op=446 RESULT err=0 tag=101 nentries=0 etime=0 notes=U [14/Sep/2015:09:30:08 -0700] conn=12 op=447 SRCH base="ou=certificateRepository,ou=ca,o=ipaca" scope=0 filter="(|(objectClass=*)(objectClass=ldapsubentry))" attrs="description" [14/Sep/2015:09:30:08 -0700] conn=12 op=447 RESULT err=0 tag=101 nentries=1 etime=0 [14/Sep/2015:09:30:19 -0700] conn=322 op=6 UNBIND </div> <div>Then in the ldap error log I see this, which makes me think there is a problem with the changelog: [14/Sep/2015:09:30:03 -0700] - dn2entry_ext: Failed to get id for changenumber=91314,cn=changelog from entryrdn index (-30993) [14/Sep/2015:09:30:03 -0700] - Operation error fetching changenumber=91314,cn=changelog (null), error -30993. [14/Sep/2015:09:30:03 -0700] DSRetroclPlugin - replog: an error occured while adding change number 91314, dn = changenumber=91314,cn=changelog: Operations error. [14/Sep/2015:09:30:03 -0700] retrocl-plugin - retrocl_postob: operation failure [1] </div> <div>After this both kdc and ldap stop responding. In the krb5kdc.log I see server errors after the user-del command is run. The only way to resume normal operations is to restart the whole machine. ipactl restart doesn't work. </div> Any help would be highly appreciated!</div> <fieldset></fieldset> </blockquote> </div> </div> </div> -- Manage your subscription for the Freeipa-users mailing list: <a moz-do-not-send="true" href="https://www.redhat.com/mailman/listinfo/freeipa-users" rel="noreferrer" target="_blank">https://www.redhat.com/mailman/listinfo/freeipa-users</a> Go to <a moz-do-not-send="true" href="http://freeipa.org" rel="noreferrer" target="_blank">http://freeipa.org</a> for more info on the project </blockquote> </div> </div> <fieldset class="mimeAttachmentHeader"></fieldset> </blockquote> </body> </html>