<div dir="ltr"><div class="gmail_default" style="font-family:trebuchet ms,sans-serif">Sure. Attached the stack trace with debuginfo installed. </div><div class="gmail_default" style="font-family:trebuchet ms,sans-serif"><br></div><div class="gmail_default" style="font-family:trebuchet ms,sans-serif">Thanks much!</div></div><div class="gmail_extra"><br><div class="gmail_quote">On 28 January 2016 at 16:53, Sumit Bose <span dir="ltr"><<a href="mailto:sbose@redhat.com" target="_blank">sbose@redhat.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">On Thu, Jan 28, 2016 at 04:42:20PM +0530, Prashant Bapat wrote:<br>
> gdb stacktrace attached.<br>
<br>
Can you install the debuginfo with<br>
<br>
debuginfo-install krb5-server-1.12.2-19.fc21.x86_64<br>
<br>
as suggested by gdb and then call 'bt full' again to get more details.<br>
Additionally the debuginfo of the freeipa package might be missing as<br>
well.<br>
<br>
bye,<br>
Sumit<br>
<span class="">><br>
> On 28 January 2016 at 16:27, Prashant Bapat <<a href="mailto:prashant@apigee.com">prashant@apigee.com</a>> wrote:<br>
><br>
> > Thanks Sumit.<br>
> ><br>
> > From the logs there is nothing unusual around the time of core dump. I<br>
> > found this one line odd though.<br>
> ><br>
</span>> > *Jan 26 03:15:58 <a href="http://ipa.example.net" rel="noreferrer" target="_blank">ipa.example.net</a> <<a href="http://ipa.example.net" rel="noreferrer" target="_blank">http://ipa.example.net</a>><br>
> > krb5kdc[4471](Error): worker 4473 exited with status 134*<br>
<div class="HOEnZb"><div class="h5">> ><br>
> ><br>
> > Let me try to get the full BT.<br>
> ><br>
> > On 28 January 2016 at 13:54, Sumit Bose <<a href="mailto:sbose@redhat.com">sbose@redhat.com</a>> wrote:<br>
> ><br>
> >> On Thu, Jan 28, 2016 at 10:25:53AM +0530, Prashant Bapat wrote:<br>
> >> > Hi,<br>
> >> ><br>
> >> > We have a FreeIPA 4.1.4 setup on F21 servers. There is 1 master and 7<br>
> >> > replicas in different regions. Earlier there was only 1 replica. Since I<br>
> >> > added new replicas, on the master node, once in a while the kerberos<br>
> >> > process dumps core and everything stops working - authentication,<br>
> >> > replication etc. If we restart everything using "ipactl restart" things<br>
> >> are<br>
> >> > back to normal.<br>
> >> ><br>
> >> > Attached is the output from journalctl for kerberos.<br>
> >> ><br>
> >> > Has anyone come across this ? Are there any pointers to troubleshooting<br>
> >> > this ?<br>
> >><br>
> >> This might be fixed recently by a patch from Simo<br>
> >> (2144b1eeb789639b8a3df287b580aeb6196188a8). But to help to better<br>
> >> identify the issue the content of the kdc logs around the time of the<br>
> >> crash might be useful. Additionally a full backtrace which you can get<br>
> >> by calling<br>
> >><br>
> >> coredumpclt gdb 4475<br>
> >><br>
> >> and then<br>
> >><br>
> >> bt full<br>
> >><br>
> >> bye,<br>
> >> Sumit<br>
> >><br>
> >> ><br>
> >> > Any help is appreciated.<br>
> >> ><br>
> >> > Thanks.<br>
> >> > --Prashant<br>
> >><br>
> >> > Jan 26 03:15:59 <a href="http://ipa.example.net" rel="noreferrer" target="_blank">ipa.example.net</a> systemd-coredump[5000]: Process 4475<br>
> >> (krb5kdc) of user 0 dumped core.<br>
> >> ><br>
> >> > Stack trace of<br>
> >> thread 4475:<br>
> >> > #0<br>
> >> 0x00007f99de8c18d7 raise (libc.so.6)<br>
> >> > #1<br>
> >> 0x00007f99de8c353a abort (libc.so.6)<br>
> >> > #2<br>
> >> 0x00007f99de8ba47d __assert_fail_base (libc.so.6)<br>
> >> > #3<br>
> >> 0x00007f99de8ba532 __assert_fail (libc.so.6)<br>
> >> > #4<br>
> >> 0x00007f99d783a78f ldap_get_values_len (libldap_r-2.4.so.2)<br>
> >> > #5<br>
> >> 0x00007f99d7c8173e ipadb_ldap_attr_to_int (ipadb.so)<br>
> >> > #6<br>
> >> 0x00007f99d7c83f9c ipadb_parse_ldap_entry (ipadb.so)<br>
> >> > #7<br>
> >> 0x00007f99d7c849ab ipadb_get_principal (ipadb.so)<br>
> >> > #8<br>
> >> 0x00007f99e0433b14 krb5_db_get_principal (libkdb5.so.7)<br>
> >> > #9<br>
> >> 0x000055768457c230 process_tgs_req (krb5kdc)<br>
> >> > #10<br>
> >> 0x0000557684579fe3 dispatch (krb5kdc)<br>
> >> > #11<br>
> >> 0x000055768458d8a0 process_packet (krb5kdc)<br>
> >> > #12<br>
> >> 0x00007f99dec4cc78 verto_fire (libverto.so.1)<br>
> >> > #13<br>
> >> 0x00007f99d6fb72a3 epoll_event_loop_once (libtevent.so.0)<br>
> >> > #14<br>
> >> 0x00007f99d6fb5787 std_event_loop_once (libtevent.so.0)<br>
> >> > #15<br>
> >> 0x00007f99d6fb1fed _tevent_loop_once (libtevent.so.0)<br>
> >> > #16<br>
> >> 0x00007f99dec4c3f7 verto_run (libverto.so.1)<br>
> >> > #17<br>
> >> 0x00005576845795ab main (krb5kdc)<br>
> >> > #18<br>
> >> 0x00007f99de8acfe0 __libc_start_main (libc.so.6)<br>
> >> > #19<br>
> >> 0x00005576845798f0 _start (krb5kdc)<br>
> >> ><br>
> >> > Jan 26 03:15:59 <a href="http://ipa.example.net" rel="noreferrer" target="_blank">ipa.example.net</a> systemd-coredump[4999]: Process 4473<br>
> >> (krb5kdc) of user 0 dumped core.<br>
> >> ><br>
> >> > Stack trace of<br>
> >> thread 4473:<br>
> >> > #0<br>
> >> 0x00007f99de8c18d7 raise (libc.so.6)<br>
> >> > #1<br>
> >> 0x00007f99de8c353a abort (libc.so.6)<br>
> >> > #2<br>
> >> 0x00007f99de8ba47d __assert_fail_base (libc.so.6)<br>
> >> > #3<br>
> >> 0x00007f99de8ba532 __assert_fail (libc.so.6)<br>
> >> > #4<br>
> >> 0x00007f99d783a78f ldap_get_values_len (libldap_r-2.4.so.2)<br>
> >> > #5<br>
> >> 0x00007f99d7c8173e ipadb_ldap_attr_to_int (ipadb.so)<br>
> >> > #6<br>
> >> 0x00007f99d7c83f9c ipadb_parse_ldap_entry (ipadb.so)<br>
> >> > #7<br>
> >> 0x00007f99d7c849ab ipadb_get_principal (ipadb.so)<br>
> >> > #8<br>
> >> 0x00007f99e0433b14 krb5_db_get_principal (libkdb5.so.7)<br>
> >> > #9<br>
> >> 0x000055768457c230 process_tgs_req (krb5kdc)<br>
> >> > #10<br>
> >> 0x0000557684579fe3 dispatch (krb5kdc)<br>
> >> > #11<br>
> >> 0x000055768458d8a0 process_packet (krb5kdc)<br>
> >> > #12<br>
> >> 0x00007f99dec4cc78 verto_fire (libverto.so.1)<br>
> >> > #13<br>
> >> 0x00007f99d6fb72a3 epoll_event_loop_once (libtevent.so.0)<br>
> >> > #14<br>
> >> 0x00007f99d6fb5787 std_event_loop_once (libtevent.so.0)<br>
> >> > #15<br>
> >> 0x00007f99d6fb1fed _tevent_loop_once (libtevent.so.0)<br>
> >> > #16<br>
> >> 0x00007f99dec4c3f7 verto_run (libverto.so.1)<br>
> >> > #17<br>
> >> 0x00005576845795ab main (krb5kdc)<br>
> >> > #18<br>
> >> 0x00007f99de8acfe0 __libc_start_main (libc.so.6)<br>
> >> > #19<br>
> >> 0x00005576845798f0 _start (krb5kdc)<br>
> >><br>
> >> > --<br>
> >> > Manage your subscription for the Freeipa-users mailing list:<br>
> >> > <a href="https://www.redhat.com/mailman/listinfo/freeipa-users" rel="noreferrer" target="_blank">https://www.redhat.com/mailman/listinfo/freeipa-users</a><br>
> >> > Go to <a href="http://freeipa.org" rel="noreferrer" target="_blank">http://freeipa.org</a> for more info on the project<br>
> >><br>
> >> --<br>
> >> Manage your subscription for the Freeipa-users mailing list:<br>
> >> <a href="https://www.redhat.com/mailman/listinfo/freeipa-users" rel="noreferrer" target="_blank">https://www.redhat.com/mailman/listinfo/freeipa-users</a><br>
> >> Go to <a href="http://freeipa.org" rel="noreferrer" target="_blank">http://freeipa.org</a> for more info on the project<br>
> >><br>
> ><br>
> ><br>
<br>
<br>
<br>
</div></div></blockquote></div><br></div>