<html><body><div style="font-family: arial,helvetica,sans-serif; font-size: 12pt; color: #000000"><div>Yes, packages installed and will generate dump next time it happens.<br data-mce-bogus="1"></div><div><br data-mce-bogus="1"></div><div>Yes, the failing RetroCL message is the same changenumber. Repeated about 2-4 times/sec.<br data-mce-bogus="1"></div><div><br></div><div><span id="zwchr" data-marker="__DIVIDER__">----- On Jan 9, 2017, at 2:54 PM, Ludwig Krispenz <lkrispen@redhat.com> wrote:<br></span></div><div data-marker="__QUOTED_TEXT__"><blockquote style="border-left: 2px solid #1010FF; margin-left: 5px; padding-left: 5px; color: #000; font-weight: normal; font-style: normal; text-decoration: none; font-family: Helvetica,Arial,sans-serif; font-size: 12pt;" data-mce-style="border-left: 2px solid #1010FF; margin-left: 5px; padding-left: 5px; color: #000; font-weight: normal; font-style: normal; text-decoration: none; font-family: Helvetica,Arial,sans-serif; font-size: 12pt;">Hi,<br> <br> there seem to be to issues here, maybe related: a hanging slapd process and the retro CL errors.<br> <br> If the slapd process is not responding can we get a pstack or gdb backtrace (<a class="moz-txt-link-freetext" href="http://www.port389.org/docs/389ds/FAQ/faq.html#debug_crashes" target="_blank" data-mce-href="http://www.port389.org/docs/389ds/FAQ/faq.html#debug_crashes">http://www.port389.org/docs/389ds/FAQ/faq.html#debug_crashes</a>) of the process ?<br> About the Retro CL messages, is it always the same changenumber which is reported ?<br> <br><div class="moz-cite-prefix">On 01/09/2017 02:06 PM, Troels Hansen wrote:<br></div><blockquote cite="mid:1988361181.1597711.1483967218116.JavaMail.zimbra@casalogic.dk"><div style="font-family: arial,helvetica,sans-serif; font-size: 12pt; color: #000000;" data-mce-style="font-family: arial,helvetica,sans-serif; font-size: 12pt; color: #000000;"><div>Hi, we have a IPA installation, which obviously needs upgrading.</div><div>Its a single server running RHEL7.1 running IPA 4.1<br></div><div><br></div><div>However, it have been running smooth untill now:<br></div><div><br></div><div>Rebooting makes everything running again, but only for a few days.<br></div><div><br></div><div>It looks like everything fails around 0:17:47 and comes up again just before 8, when the server is rebooted.<br></div><div><br></div><div>Jan 6 00:19:46 fbbidm01 winbindd[2965]: failed to bind to server ldapi://%2fvar%2frun%2fslapd-DOMAIN.LAN.socket with dn="[Anonymous bind]" Error: Local error<br> Jan 6 00:19:46 fbbidm01 winbindd[2965]: (unknown)<br> Jan 6 00:20:29 fbbidm01 winbindd[2965]: [2017/01/06 00:20:29.758332, 0] ipa_sam.c:4128(bind_callback_cleanup)</div><div><br></div><div>Looking at the SLAPD logs also reveals it stopped answering:<br> <br> [06/Jan/2017:00:17:47 +0100] conn=40702 op=62 SRCH base="cn=radius_aura_admin,cn=groups,cn=accounts,dc=domain,dc=lan" scope=0 filter="(objectClass=*)" attrs="cn"<br> [06/Jan/2017:00:17:47 +0100] conn=40702 op=62 RESULT err=0 tag=101 nentries=1 etime=0<br> [06/Jan/2017:00:17:47 +0100] conn=40702 op=63 SRCH base="cn=radius_users,cn=groups,cn=accounts,dc=domain,dc=lan" scope=0 filter="(objectClass=*)" attrs="cn"<br> [06/Jan/2017:00:17:47 +0100] conn=40702 op=63 RESULT err=0 tag=101 nentries=1 etime=0<br> [06/Jan/2017:00:17:47 +0100] conn=40702 op=64 SRCH base="cn=system_radius_users,cn=groups,cn=accounts,dc=domain,dc=lan" scope=0 filter="(objectClass=*)" attrs="cn"<br> [06/Jan/2017:00:17:47 +0100] conn=40702 op=64 RESULT err=0 tag=101 nentries=1 etime=0<br> [06/Jan/2017:00:17:48 +0100] conn=40702 op=65 SRCH base="cn=accounts,dc=domain,dc=lan" scope=2 filter="(uid=sys_prov_aura)" attrs=ALL<br> [06/Jan/2017:00:17:48 +0100] conn=40702 op=65 RESULT err=0 tag=101 nentries=1 etime=0<br> [06/Jan/2017:00:17:48 +0100] conn=40702 op=66 BIND dn="uid=sys_prov_aura,cn=users,cn=accounts,dc=domain,dc=lan" method=128 version=3<br> [06/Jan/2017:00:17:48 +0100] conn=40702 op=66 RESULT err=0 tag=97 nentries=0 etime=0 dn="uid=sys_prov_aura,cn=users,cn=accounts,dc=domain,dc=lan"<br> [06/Jan/2017:00:17:51 +0100] conn=40703 fd=158 slot=158 connection from 10.250.8.66 to 10.250.8.58<br> [06/Jan/2017:00:17:53 +0100] conn=40704 fd=159 slot=159 SSL connection from 10.250.8.37 to 10.250.8.58<br> [06/Jan/2017:00:18:02 +0100] conn=40705 fd=160 slot=160 SSL connection from 10.250.8.57 to 10.250.8.58<br> [06/Jan/2017:00:18:02 +0100] conn=40706 fd=161 slot=161 SSL connection from 10.250.20.102 to 10.250.8.58<br> [06/Jan/2017:00:18:03 +0100] conn=40707 fd=162 slot=162 SSL connection from 10.250.20.102 to 10.250.8.58<br> [06/Jan/2017:00:18:58 +0100] conn=40708 fd=163 slot=163 connection from 10.250.8.66 to 10.250.8.58<br> [06/Jan/2017:00:19:03 +0100] conn=40709 fd=164 slot=164 connection from local to /var/run/slapd-DOMAIN.LAN.socket<br> [06/Jan/2017:00:19:35 +0100] conn=40710 fd=165 slot=165 connection from 10.250.8.58 to 10.250.8.58<br> [06/Jan/2017:00:19:35 +0100] conn=40711 fd=166 slot=166 connection from 10.150.27.7 to 10.250.8.58<br> [06/Jan/2017:00:19:43 +0100] conn=40712 fd=167 slot=167 SSL connection from 10.250.20.102 to 10.250.8.58<br> [06/Jan/2017:00:19:46 +0100] conn=40713 fd=168 slot=168 connection from local to /var/run/slapd-DOMAIN.LAN.socket<br> <br> It looks like it just stops answering at 00:17:48<br> <br> The slapd error log reveals nothing:</div><div><br> [06/Jan/2017:00:17:34 +0100] DSRetroclPlugin - replog: an error occured while adding change number 3875312, dn = changenumber=3875312,cn=changelog: Already exists. <br> [06/Jan/2017:00:17:34 +0100] retrocl-plugin - retrocl_postob: operation failure [68]<br> [06/Jan/2017:07:57:21 +0100] - slapd shutting down - signaling operation threads - op stack size 0 max work q size 735 max work q stack size 23<br> [06/Jan/2017:07:57:21 +0100] - slapd shutting down - waiting for 30 threads to terminate<br> [06/Jan/2017:07:58:02 +0100] SSL Initialization - Configured SSL version range: min: TLS1.0, max: TLS1.2</div><div><br></div><div>However, see a gazillion of these lines in the error log:<br></div><div><br></div><div>DSRetroclPlugin - replog: an error occured while adding change number 3875312, dn = changenumber=3875312,cn=changelog: Already exists.</div><div><br></div><div>Anyone with some thoughts about this, other that "Just upgrade".<br></div><div><br></div><div>-- <br></div><div><p style="margin: 5px 0px 0px; font-family: arial,verdana,sans-serif; font-size: 12px;" data-mce-style="margin: 5px 0px 0px; font-family: arial,verdana,sans-serif; font-size: 12px;">Med venlig hilsen</p><p style="margin: 10px 0px 0px; font-family: arial,verdana,sans-serif; font-size: 14px;" data-mce-style="margin: 10px 0px 0px; font-family: arial,verdana,sans-serif; font-size: 14px;"><b>Troels Hansen</b></p><p style="margin: 3px 0px 0px; font-family: arial,verdana,sans-serif; font-size: 12px;" data-mce-style="margin: 3px 0px 0px; font-family: arial,verdana,sans-serif; font-size: 12px;">Systemkonsulent</p><p style="margin: 4px 2px 0px 0px; font-family: arial,verdana,sans-serif; color: #4c4c4c; font-size: 14px; font-weight: bold;" data-mce-style="margin: 4px 2px 0px 0px; font-family: arial,verdana,sans-serif; color: #4c4c4c; font-size: 14px; font-weight: bold;">Casalogic A/S</p><div><img src="http://www.casalogic.dk/signatur/casalogic_green_spacer_line.png" border="0"></div><p style="margin: 5px 0px 0px; font-family: arial,verdana,sans-serif; font-size: 12px;" data-mce-style="margin: 5px 0px 0px; font-family: arial,verdana,sans-serif; font-size: 12px;">T (+45) 70 20 10 63</p><p style="margin: 5px 0px 0px; font-family: arial,verdana,sans-serif; font-size: 12px;" data-mce-style="margin: 5px 0px 0px; font-family: arial,verdana,sans-serif; font-size: 12px;">M (+45) 22 43 71 57</p><div><a title="Download vCard" href="http://www.casalogic.dk/signatur/th.vcf" target="_blank" data-mce-href="http://www.casalogic.dk/signatur/th.vcf"><img src="http://www.casalogic.dk/signatur/vcard_download_small.png" border="0"></a> <a title="Follow
us on LinkedIn" href="http://www.linkedin.com/company/67524" target="_blank" data-mce-href="http://www.linkedin.com/company/67524"><img src="http://www.casalogic.dk/signatur/linkedin_logo_20x20.png" border="0"></a> <a title="Follow
us on Twitter" href="http://twitter.com/casalogic" target="_blank" data-mce-href="http://twitter.com/casalogic"><img src="http://www.casalogic.dk/signatur/twitter_logo_20x20.png" border="0"></a><br></div><div>Red Hat, SUSE, VMware, Citrix, Novell, Yellowfin BI, EnterpriseDB, Sophos og meget mere.<br></div></div></div><br><fieldset class="mimeAttachmentHeader"></fieldset><br></blockquote><br><pre class="moz-signature">--
Red Hat GmbH, <a class="moz-txt-link-freetext" href="http://www.de.redhat.com/" target="_blank" data-mce-href="http://www.de.redhat.com/">http://www.de.redhat.com/</a>, Registered seat: Grasbrunn,
Commercial register: Amtsgericht Muenchen, HRB 153243,
Managing Directors: Charles Cachera, Michael Cunningham, Michael O'Neill, Eric Shander</pre><br>-- <br>Manage your subscription for the Freeipa-users mailing list:<br>https://www.redhat.com/mailman/listinfo/freeipa-users<br>Go to http://freeipa.org for more info on the project<br></blockquote></div><div><br></div><div data-marker="__SIG_POST__">-- <br></div><div><p style="MARGIN: 5px 0px 0px; FONT-FAMILY: arial,verdana,sans-serif; FONT-SIZE: 12px" data-mce-style="margin: 5px 0px 0px; font-family: arial,verdana,sans-serif; font-size: 12px;">Med venlig hilsen</p><p style="MARGIN: 10px 0px 0px; FONT-FAMILY: arial,verdana,sans-serif; FONT-SIZE: 14px" data-mce-style="margin: 10px 0px 0px; font-family: arial,verdana,sans-serif; font-size: 14px;"><b>Troels Hansen</b></p><p style="MARGIN: 3px 0px 0px; FONT-FAMILY: arial,verdana,sans-serif; FONT-SIZE: 12px" data-mce-style="margin: 3px 0px 0px; font-family: arial,verdana,sans-serif; font-size: 12px;">Systemkonsulent</p><p style="MARGIN: 4px 2px 0px 0px; FONT-FAMILY: arial,verdana,sans-serif; COLOR: #4c4c4c; FONT-SIZE: 14px; FONT-WEIGHT: bold" data-mce-style="margin: 4px 2px 0px 0px; font-family: arial,verdana,sans-serif; color: #4c4c4c; font-size: 14px; font-weight: bold;">Casalogic A/S</p><div><img src="http://www.casalogic.dk/signatur/casalogic_green_spacer_line.png" data-mce-src="http://www.casalogic.dk/signatur/casalogic_green_spacer_line.png" border="0"></div><p style="MARGIN: 5px 0px 0px; FONT-FAMILY: arial,verdana,sans-serif; FONT-SIZE: 12px" data-mce-style="margin: 5px 0px 0px; font-family: arial,verdana,sans-serif; font-size: 12px;">T (+45) 70 20 10 63</p><p style="MARGIN: 5px 0px 0px; FONT-FAMILY: arial,verdana,sans-serif; FONT-SIZE: 12px" data-mce-style="margin: 5px 0px 0px; font-family: arial,verdana,sans-serif; font-size: 12px;">M (+45) 22 43 71 57</p><div><a title="Download vCard" href="http://www.casalogic.dk/signatur/th.vcf" data-mce-href="http://www.casalogic.dk/signatur/th.vcf"><img src="http://www.casalogic.dk/signatur/vcard_download_small.png" data-mce-src="http://www.casalogic.dk/signatur/vcard_download_small.png" border="0"></a> <a title="Follow us on LinkedIn" href="http://www.linkedin.com/company/67524" data-mce-href="http://www.linkedin.com/company/67524"><img src="http://www.casalogic.dk/signatur/linkedin_logo_20x20.png" data-mce-src="http://www.casalogic.dk/signatur/linkedin_logo_20x20.png" border="0"></a> <a title="Follow us on Twitter" href="http://twitter.com/casalogic" data-mce-href="http://twitter.com/casalogic"><img src="http://www.casalogic.dk/signatur/twitter_logo_20x20.png" data-mce-src="http://www.casalogic.dk/signatur/twitter_logo_20x20.png" border="0"></a><br></div><div>Red Hat, SUSE, VMware, Citrix, Novell, Yellowfin BI, EnterpriseDB, Sophos og meget mere.<br></div></div></div></body></html>