<html>
  <head>
    <meta content="text/html; charset=ISO-8859-1"
      http-equiv="Content-Type">
  </head>
  <body bgcolor="#FFFFFF" text="#000000">
    Hi,<br>
    <br>
    there seem to be to issues here, maybe related: a hanging slapd
    process and the retro CL errors.<br>
    <br>
    If the slapd process is not responding can we get a pstack or gdb
    backtrace (<a class="moz-txt-link-freetext" href="http://www.port389.org/docs/389ds/FAQ/faq.html#debug_crashes">http://www.port389.org/docs/389ds/FAQ/faq.html#debug_crashes</a>)
    of the process ?<br>
    About the Retro CL messages, is it always the same changenumber
    which is  reported ?<br>
    <br>
    <div class="moz-cite-prefix">On 01/09/2017 02:06 PM, Troels Hansen
      wrote:<br>
    </div>
    <blockquote
      cite="mid:1988361181.1597711.1483967218116.JavaMail.zimbra@casalogic.dk"
      type="cite">
      <div style="font-family: arial,helvetica,sans-serif; font-size:
        12pt; color: #000000">
        <div>Hi, we have a IPA installation, which obviously needs
          upgrading.</div>
        <div>Its a single server running RHEL7.1 running IPA 4.1<br>
        </div>
        <div><br data-mce-bogus="1">
        </div>
        <div>However, it have been running smooth untill now:<br
            data-mce-bogus="1">
        </div>
        <div><br data-mce-bogus="1">
        </div>
        <div>Rebooting makes everything running again, but only for a
          few days.<br data-mce-bogus="1">
        </div>
        <div><br data-mce-bogus="1">
        </div>
        <div>It looks like everything fails around 0:17:47 and comes up
          again just before 8, when the server is rebooted.<br
            data-mce-bogus="1">
        </div>
        <div><br data-mce-bogus="1">
        </div>
        <div>Jan  6 00:19:46 fbbidm01 winbindd[2965]: failed to bind to
          server ldapi://%2fvar%2frun%2fslapd-DOMAIN.LAN.socket with
          dn="[Anonymous bind]" Error: Local error<br>
          Jan  6 00:19:46 fbbidm01 winbindd[2965]: (unknown)<br>
          Jan  6 00:20:29 fbbidm01 winbindd[2965]: [2017/01/06
          00:20:29.758332,  0] ipa_sam.c:4128(bind_callback_cleanup)</div>
        <div><br data-mce-bogus="1">
        </div>
        <div>Looking at the SLAPD logs also reveals it stopped
          answering:<br>
          <br>
          [06/Jan/2017:00:17:47 +0100] conn=40702 op=62 SRCH
          base="cn=radius_aura_admin,cn=groups,cn=accounts,dc=domain,dc=lan"
          scope=0 filter="(objectClass=*)" attrs="cn"<br>
          [06/Jan/2017:00:17:47 +0100] conn=40702 op=62 RESULT err=0
          tag=101 nentries=1 etime=0<br>
          [06/Jan/2017:00:17:47 +0100] conn=40702 op=63 SRCH
          base="cn=radius_users,cn=groups,cn=accounts,dc=domain,dc=lan"
          scope=0 filter="(objectClass=*)" attrs="cn"<br>
          [06/Jan/2017:00:17:47 +0100] conn=40702 op=63 RESULT err=0
          tag=101 nentries=1 etime=0<br>
          [06/Jan/2017:00:17:47 +0100] conn=40702 op=64 SRCH
          base="cn=system_radius_users,cn=groups,cn=accounts,dc=domain,dc=lan"
          scope=0 filter="(objectClass=*)" attrs="cn"<br>
          [06/Jan/2017:00:17:47 +0100] conn=40702 op=64 RESULT err=0
          tag=101 nentries=1 etime=0<br>
          [06/Jan/2017:00:17:48 +0100] conn=40702 op=65 SRCH
          base="cn=accounts,dc=domain,dc=lan" scope=2
          filter="(uid=sys_prov_aura)" attrs=ALL<br>
          [06/Jan/2017:00:17:48 +0100] conn=40702 op=65 RESULT err=0
          tag=101 nentries=1 etime=0<br>
          [06/Jan/2017:00:17:48 +0100] conn=40702 op=66 BIND
          dn="uid=sys_prov_aura,cn=users,cn=accounts,dc=domain,dc=lan"
          method=128 version=3<br>
          [06/Jan/2017:00:17:48 +0100] conn=40702 op=66 RESULT err=0
          tag=97 nentries=0 etime=0
          dn="uid=sys_prov_aura,cn=users,cn=accounts,dc=domain,dc=lan"<br>
          [06/Jan/2017:00:17:51 +0100] conn=40703 fd=158 slot=158
          connection from 10.250.8.66 to 10.250.8.58<br>
          [06/Jan/2017:00:17:53 +0100] conn=40704 fd=159 slot=159 SSL
          connection from 10.250.8.37 to 10.250.8.58<br>
          [06/Jan/2017:00:18:02 +0100] conn=40705 fd=160 slot=160 SSL
          connection from 10.250.8.57 to 10.250.8.58<br>
          [06/Jan/2017:00:18:02 +0100] conn=40706 fd=161 slot=161 SSL
          connection from 10.250.20.102 to 10.250.8.58<br>
          [06/Jan/2017:00:18:03 +0100] conn=40707 fd=162 slot=162 SSL
          connection from 10.250.20.102 to 10.250.8.58<br>
          [06/Jan/2017:00:18:58 +0100] conn=40708 fd=163 slot=163
          connection from 10.250.8.66 to 10.250.8.58<br>
          [06/Jan/2017:00:19:03 +0100] conn=40709 fd=164 slot=164
          connection from local to /var/run/slapd-DOMAIN.LAN.socket<br>
          [06/Jan/2017:00:19:35 +0100] conn=40710 fd=165 slot=165
          connection from 10.250.8.58 to 10.250.8.58<br>
          [06/Jan/2017:00:19:35 +0100] conn=40711 fd=166 slot=166
          connection from 10.150.27.7 to 10.250.8.58<br>
          [06/Jan/2017:00:19:43 +0100] conn=40712 fd=167 slot=167 SSL
          connection from 10.250.20.102 to 10.250.8.58<br>
          [06/Jan/2017:00:19:46 +0100] conn=40713 fd=168 slot=168
          connection from local to /var/run/slapd-DOMAIN.LAN.socket<br>
          <br>
          It looks like it just stops answering at 00:17:48<br>
          <br>
          The slapd error log reveals nothing:</div>
        <div><br>
          [06/Jan/2017:00:17:34 +0100] DSRetroclPlugin - replog: an
          error occured while adding change number 3875312, dn =
          changenumber=3875312,cn=changelog: Already exists. <br>
          [06/Jan/2017:00:17:34 +0100] retrocl-plugin - retrocl_postob:
          operation failure [68]<br>
          [06/Jan/2017:07:57:21 +0100] - slapd shutting down - signaling
          operation threads - op stack size 0 max work q size 735 max
          work q stack size 23<br>
          [06/Jan/2017:07:57:21 +0100] - slapd shutting down - waiting
          for 30 threads to terminate<br>
          [06/Jan/2017:07:58:02 +0100] SSL Initialization - Configured
          SSL version range: min: TLS1.0, max: TLS1.2</div>
        <div><br data-mce-bogus="1">
        </div>
        <div>However, see a gazillion of these lines in the error log:<br>
        </div>
        <div><br data-mce-bogus="1">
        </div>
        <div>DSRetroclPlugin - replog: an error occured while adding
          change number 3875312, dn = changenumber=3875312,cn=changelog:
          Already exists.</div>
        <div><br data-mce-bogus="1">
        </div>
        <div>Anyone with some thoughts about this, other that "Just
          upgrade".<br>
        </div>
        <div><br data-mce-bogus="1">
        </div>
        <div data-marker="__SIG_POST__">-- <br>
        </div>
        <div>
          <p style="MARGIN: 5px 0px 0px; FONT-FAMILY:
            arial,verdana,sans-serif; FONT-SIZE: 12px"
            data-mce-style="margin: 5px 0px 0px; font-family:
            arial,verdana,sans-serif; font-size: 12px;">Med venlig
            hilsen</p>
          <p style="MARGIN: 10px 0px 0px; FONT-FAMILY:
            arial,verdana,sans-serif; FONT-SIZE: 14px"
            data-mce-style="margin: 10px 0px 0px; font-family:
            arial,verdana,sans-serif; font-size: 14px;"><b>Troels Hansen</b></p>
          <p style="MARGIN: 3px 0px 0px; FONT-FAMILY:
            arial,verdana,sans-serif; FONT-SIZE: 12px"
            data-mce-style="margin: 3px 0px 0px; font-family:
            arial,verdana,sans-serif; font-size: 12px;">Systemkonsulent</p>
          <p style="MARGIN: 4px 2px 0px 0px; FONT-FAMILY:
            arial,verdana,sans-serif; COLOR: #4c4c4c; FONT-SIZE: 14px;
            FONT-WEIGHT: bold" data-mce-style="margin: 4px 2px 0px 0px;
            font-family: arial,verdana,sans-serif; color: #4c4c4c;
            font-size: 14px; font-weight: bold;">Casalogic A/S</p>
          <div><img moz-do-not-send="true"
              src="http://www.casalogic.dk/signatur/casalogic_green_spacer_line.png"
data-mce-src="http://www.casalogic.dk/signatur/casalogic_green_spacer_line.png"
              border="0"></div>
          <p style="MARGIN: 5px 0px 0px; FONT-FAMILY:
            arial,verdana,sans-serif; FONT-SIZE: 12px"
            data-mce-style="margin: 5px 0px 0px; font-family:
            arial,verdana,sans-serif; font-size: 12px;">T  (+45) 70 20
            10 63</p>
          <p style="MARGIN: 5px 0px 0px; FONT-FAMILY:
            arial,verdana,sans-serif; FONT-SIZE: 12px"
            data-mce-style="margin: 5px 0px 0px; font-family:
            arial,verdana,sans-serif; font-size: 12px;">M (+45) 22 43 71
            57</p>
          <div><a moz-do-not-send="true" title="Download vCard"
              href="http://www.casalogic.dk/signatur/th.vcf"
              data-mce-href="http://www.casalogic.dk/signatur/th.vcf"><img
                moz-do-not-send="true"
                src="http://www.casalogic.dk/signatur/vcard_download_small.png"
data-mce-src="http://www.casalogic.dk/signatur/vcard_download_small.png"
                border="0"></a> <a moz-do-not-send="true" title="Follow
              us on LinkedIn"
              href="http://www.linkedin.com/company/67524"
              data-mce-href="http://www.linkedin.com/company/67524"><img
                moz-do-not-send="true"
                src="http://www.casalogic.dk/signatur/linkedin_logo_20x20.png"
data-mce-src="http://www.casalogic.dk/signatur/linkedin_logo_20x20.png"
                border="0"></a> <a moz-do-not-send="true" title="Follow
              us on Twitter" href="http://twitter.com/casalogic"
              data-mce-href="http://twitter.com/casalogic"><img
                moz-do-not-send="true"
                src="http://www.casalogic.dk/signatur/twitter_logo_20x20.png"
data-mce-src="http://www.casalogic.dk/signatur/twitter_logo_20x20.png"
                border="0"></a><br>
          </div>
          <div>Red Hat, SUSE, VMware, Citrix, Novell, Yellowfin BI,
            EnterpriseDB, Sophos og meget mere.<br>
          </div>
        </div>
      </div>
      <br>
      <fieldset class="mimeAttachmentHeader"></fieldset>
      <br>
    </blockquote>
    <br>
    <pre class="moz-signature" cols="72">-- 
Red Hat GmbH, <a class="moz-txt-link-freetext" href="http://www.de.redhat.com/">http://www.de.redhat.com/</a>, Registered seat: Grasbrunn, 
Commercial register: Amtsgericht Muenchen, HRB 153243,
Managing Directors: Charles Cachera, Michael Cunningham, Michael O'Neill, Eric Shander</pre>
  </body>
</html>