<html>
  <head>
    <meta content="text/html; charset=UTF-8" http-equiv="Content-Type">
  </head>
  <body bgcolor="#FFFFFF" text="#000000">
    <br>
    <div class="moz-cite-prefix">On 05/18/2017 05:35 PM, Christophe
      TREFOIS wrote:<br>
    </div>
    <blockquote cite="mid:7DF99717-0854-4DE7-9CC3-348E62910CC2@uni.lu"
      type="cite">
      <meta http-equiv="Context-Type" content="text/html; charset=utf-8">
      Dear Ludwig,
      <div class=""><br class="">
      </div>
      <div class="">Thanks for your help in IRC to guide me in running
        the right commands.</div>
      <div class=""><br class="">
      </div>
      <div class="">Here is the output, toto1 and toto2 are CA master,
        and toto3 and toto4 are non CA master. The problematic replica
        was toto3, and after re-init, we haven’t seen any errors in the
        log anymore.</div>
      <div class=""><br class="">
      </div>
      <div class=""><a moz-do-not-send="true"
href="https://paste.fedoraproject.org/paste/j8c30CZPyh8rPymjbKSvZF5M1UNdIGYhyRLivL9gydE="
          class="">https://paste.fedoraproject.org/paste/j8c30CZPyh8rPymjbKSvZF5M1UNdIGYhyRLivL9gydE=</a></div>
      <div class=""><br class="">
      </div>
      <div class="">I also ran ipa-replica-manage on all replicas to all
        replicas, so total of 16 command, and found all of them reported
        “incremental update succeeded”.</div>
      <div class=""><br class="">
      </div>
      <div class="">As discussed, I’m not sure what I’m looking at with
        the RUV stuff above, and any explanation for a newcomer to ldap
        / ds / freeipa would be greatly appreciated.</div>
    </blockquote>
    ok, here is a quick explanation of the csn/ruv stuff. <br>
    <br>
    each change applied on a server gets a CSN (change sequence number),
    it basically consists of a timestamp and an identifier of the
    replica where it was originally applied, so in 59095fe1000b00120000
    there is a time stamp: 59095fe1 and a replicaid: 0012 == 18, the
    rest of the csn isused to serialize csns within the one second
    resolution of a timestamp.<br>
    a change is applied to the main database and written to the
    changelog, with the csn as key.<br>
    <br>
    now each replica keeps track of the latest csn it has seen for each
    replicaID, so you get a vector of max csns, this is called RUV
    (replica update vector).<br>
    In a replication session, the supplier compares its own ruv with the
    ruv of the consumer and so decides if it has changes which the
    consumer has not yet seen.<br>
    based on the consumer ruv it determines the start csn to send
    updates.<br>
    <br>
    <br>
    <blockquote cite="mid:7DF99717-0854-4DE7-9CC3-348E62910CC2@uni.lu"
      type="cite">
      <div class=""><br class="">
      </div>
      <div class="">Thanks a lot for your help!</div>
      <div class=""><br class="">
      </div>
      <div class="">Kind regards,</div>
      <div class="">Christophe aka Trefex</div>
      <div class=""><br class="">
        <div>
          <blockquote type="cite" class="">
            <div class="">On 18 May 2017, at 17:04, Christophe TREFOIS
              <<a moz-do-not-send="true"
                href="mailto:christophe.trefois@uni.lu" class="">christophe.trefois@uni.lu</a>>
              wrote:</div>
            <br class="Apple-interchange-newline">
            <div class="">
              <div class="">
                Hi Ludwig,
                <div class=""><br class="">
                </div>
                <div class="">Since we were scared, we did a full
                  re-init of that specific replica from the CA master,
                  and it looks like the issue is not appearing anymore.</div>
                <div class=""><br class="">
                </div>
                <div class="">Is this sufficient, or should we still
                  investigate ?</div>
                <div class=""><br class="">
                </div>
                <div class="">Thanks for your help!</div>
                <div class="">Christophe<br class="">
                  <div class="">
                    <div class="">
                      <div class="">
                        <div class="">
                          <p class="">
                            <span class="">-- </span></p>
                          <p class="">
                            <span class="">Dr Christophe Trefois,
                              Dipl.-Ing.</span><span
                              class="Apple-converted-space"> </span><span
                              class="Apple-converted-space"> </span><span
                              class=""></span><br class="">
                            <span class="">Technical Specialist /
                              Post-Doc</span></p>
                          <p class="">
                            <span class="">UNIVERSITÉ DU LUXEMBOURG</span><br
                              class="">
                            <span class=""><br class="">
                            </span><span class="">LUXEMBOURG CENTRE FOR
                              SYSTEMS BIOMEDICINE</span><br class="">
                            <span class="">Campus Belval | House of
                              Biomedicine<span
                                class="Apple-converted-space"> </span><span
                                class="Apple-converted-space"> </span><br
                                class="">
                              <span class="Apple-converted-space">6,
                                avenue du Swing </span><br class="">
                              L-4367 Belvaux<span
                                class="Apple-converted-space"> </span><span
                                class="Apple-converted-space"> </span></span><br
                              class="">
                            <span class="">T:<span
                                class="Apple-converted-space"> </span></span><span
                              class="">+352 46 66 44 6124</span><span
                              class="Apple-converted-space"> </span><br
                              class="">
                            <span class="">F:<span
                                class="Apple-converted-space"> </span></span><span
                              class="">+352 46 66 44 6949</span><span
                              class="Apple-converted-space"> </span><span
                              class="Apple-converted-space"> </span><span
                              class=""><br class="">
                            </span><a moz-do-not-send="true"
                              href="http://www.uni.lu/lcsb" class="">http://www.uni.lu/lcsb</a></p>
                          <p class="">
                            <a moz-do-not-send="true"
                              href="https://www.facebook.com/trefex"
                              class=""><img moz-do-not-send="true"
                                data-filename="facebook.png"
                                alt="Facebook" class="" height="24"
                                width="24"></a><span
                              class="Apple-converted-space"> </span><span
                              class="Apple-converted-space"> </span><a
                              moz-do-not-send="true"
                              href="https://twitter.com/Trefex" class=""><img
                                moz-do-not-send="true"
                                data-filename="twitter.png"
                                alt="Twitter" class="" height="24"
                                width="24"></a><span
                              class="Apple-converted-space"> </span><span
                              class="Apple-converted-space"> </span><a
                              moz-do-not-send="true"
                              href="https://plus.google.com/+ChristopheTrefois/"
                              class=""><img moz-do-not-send="true"
                                data-filename="googleplus.png"
                                alt="Google Plus" class="" height="24"
                                width="24"></a><span
                              class="Apple-converted-space"> </span><span
                              class="Apple-converted-space"> </span><a
                              moz-do-not-send="true"
                              href="https://www.linkedin.com/in/trefoischristophe"
                              class=""><img moz-do-not-send="true"
                                data-filename="linkedin.png"
                                alt="Linkedin" class="" height="24"
                                width="24"></a><span
                              class="Apple-converted-space"> </span><span
                              class="Apple-converted-space"> </span><a
                              moz-do-not-send="true" class=""><img
                                moz-do-not-send="true"
                                data-filename="skype.png" alt="skype"
                                class="" height="24" width="24"></a></p>
                          <div class="">
                            <br class="webkit-block-placeholder">
                          </div>
                          <p class="">
                            ----<br class="">
                            This message is confidential and may contain
                            privileged information.<span
                              class="Apple-converted-space"> </span><br
                              class="">
                            It is intended for the named recipient only.<span
                              class="Apple-converted-space"> </span><br
                              class="">
                            If you receive it in error please notify me
                            and permanently delete the original message
                            and any copies.<span
                              class="Apple-converted-space"> </span><br
                              class="">
                            ----<br class="">
                          </p>
                           <span class="Apple-converted-space"> </span></div>
                      </div>
                    </div>
                  </div>
                  <br class="">
                  <div class="">
                    <blockquote type="cite" class="">
                      <div class="">On 18 May 2017, at 16:11, Ludwig
                        Krispenz <<a moz-do-not-send="true"
                          href="mailto:lkrispen@redhat.com" class="">lkrispen@redhat.com</a>>
                        wrote:</div>
                      <br class="Apple-interchange-newline">
                      <div class="">
                        <div class="">hi,<br class="">
                          <br class="">
                          there was a change that in the case of a
                          missing csn ds would not silently use a
                          "close" one and continue, but log an error,
                          backoff and retry - after updates on other
                          masters the staring csn coudl change and
                          replication continue.<br class="">
                          <br class="">
                          Now, in your case the csn reported missing:
                          59095fe1000b00120000<br class="">
                          has a time stamp from May,3rd, so it could
                          very well be correct that this csn is no
                          longer found in the changelog.<br class="">
                          <br class="">
                          To continue analysis, could you provide the
                          replicaids of all your current replicas, and
                          which is the replicaid of the sever logging
                          the change and the ruvs of the replicas from
                          all servers.<br class="">
                          ldapsearch  .... -D "cn=directory manager"
                          .... -b cn=config "objectclass=nsds5replica"
                          nsds50ruv<br class="">
                          <br class="">
                          Regards,<br class="">
                          Ludwig<br class="">
                          <br class="">
                          <div class="moz-cite-prefix">On 05/18/2017
                            03:09 PM, Christophe TREFOIS wrote:<br
                              class="">
                          </div>
                          <blockquote
                            cite="mid:522A7500-1BA1-434A-BAAB-B1C1C0EB524B@uni.lu"
                            type="cite" class="">
                            <div class="">Hi all,</div>
                            <div class=""><br class="">
                            </div>
                            <div class="">Did a yum update on one of my
                              replicas, non CA master, and upgrade was
                              successful (ipupgrade.log) said so. </div>
                            <div class=""><br class="">
                            </div>
                            <div class=""><br class="">
                            </div>
                            <div class="">Hwoever, now every few seconds
                              I get the following message. <a
                                moz-do-not-send="true"
href="https://paste.fedoraproject.org/paste/wS4x9KvD3EB0gv2HAsj6X15M1UNdIGYhyRLivL9gydE="
                                class="">
https://paste.fedoraproject.org/paste/wS4x9KvD3EB0gv2HAsj6X15M1UNdIGYhyRLivL9gydE=</a></div>
                            <div class=""><br class="">
                            </div>
                            <div class="">Does anybody know how to
                              proceed and if this is important?</div>
                            <div class="">ipa-replica-manage says,
                              backing off, retrying later, so not sure
                              if replication happens successfully or not
                              and what to do ??</div>
                            <div class=""><br class="">
                            </div>
                            <div class="">Setup: CentOS 7.3 all
                              up-to-date, 2 CA master, 2 non CA master
                              in diamond replication.</div>
                            <div class=""><br class="">
                            </div>
                            <div class="">Remaining replicas were
                              upgraded today as well, and don’t seem to
                              complain. Only 1 of them complains.</div>
                            <div class=""><br class="">
                            </div>
                            <div class="">389-ds-base-libs-1.3.5.10-20.el7_3.x86_64</div>
                            <div class="">389-ds-base-1.3.5.10-20.el7_3.x86_64</div>
                            <div class=""><br class="">
                            </div>
                            <div class=""><br class="">
                            </div>
                            <div class="">
                              <div class="">[root@lums3 ~]# rpm -qa |
                                grep ipa</div>
                              <div class="">libipa_hbac-1.14.0-43.el7_3.14.x86_64</div>
                              <div class="">python-iniparse-0.4-9.el7.noarch</div>
                              <div class="">ipa-admintools-4.4.0-14.el7.centos.7.noarch</div>
                              <div class="">python2-ipaserver-4.4.0-14.el7.centos.7.noarch</div>
                              <div class="">python2-ipalib-4.4.0-14.el7.centos.7.noarch</div>
                              <div class="">sssd-ipa-1.14.0-43.el7_3.14.x86_64</div>
                              <div class="">python-ipaddress-1.0.16-2.el7.noarch</div>
                              <div class="">python2-ipaclient-4.4.0-14.el7.centos.7.noarch</div>
                              <div class="">ipa-server-common-4.4.0-14.el7.centos.7.noarch</div>
                              <div class="">ipa-client-common-4.4.0-14.el7.centos.7.noarch</div>
                              <div class="">ipa-client-4.4.0-14.el7.centos.7.x86_64</div>
                              <div class="">ipa-common-4.4.0-14.el7.centos.7.noarch</div>
                              <div class="">python-libipa_hbac-1.14.0-43.el7_3.14.x86_64</div>
                              <div class="">ipa-server-4.4.0-14.el7.centos.7.x86_64</div>
                            </div>
                            <div class=""><br class="">
                            </div>
                            <div class="">Thanks a lot for any pointers,</div>
                            <div class="">Christophe </div>
                            <div class="">
                              <div class="">
                                <div class="">
                                  <div class="">
                                    <p class=""><span class="">-- </span></p>
                                    <p class=""><span class="">Dr
                                        Christophe Trefois, Dipl.-Ing.</span><span
                                        class="Apple-converted-space"> </span><span
                                        class="Apple-converted-space"> </span><span
                                        class=""></span><br class="">
                                      <span class="">Technical
                                        Specialist / Post-Doc</span></p>
                                    <p class=""><span class="">UNIVERSITÉ
                                        DU LUXEMBOURG</span><br class="">
                                      <span class=""><br class="">
                                      </span><span class="">LUXEMBOURG
                                        CENTRE FOR SYSTEMS BIOMEDICINE</span><br
                                        class="">
                                      <span class="">Campus Belval |
                                        House of Biomedicine<span
                                          class="Apple-converted-space"> </span><span
                                          class="Apple-converted-space"> </span><br
                                          class="">
                                        <span
                                          class="Apple-converted-space">6,
                                          avenue du Swing </span><br
                                          class="">
                                        L-4367 Belvaux<span
                                          class="Apple-converted-space"> </span><span
                                          class="Apple-converted-space"> </span></span><br
                                        class="">
                                      <span class="">T:<span
                                          class="Apple-converted-space"> </span></span><span
                                        class="">+352 46 66 44 6124</span><span
                                        class="Apple-converted-space"> </span><br
                                        class="">
                                      <span class="">F:<span
                                          class="Apple-converted-space"> </span></span><span
                                        class="">+352 46 66 44 6949</span><span
                                        class="Apple-converted-space"> </span><span
                                        class="Apple-converted-space"> </span><span
                                        class=""><br class="">
                                      </span><a moz-do-not-send="true"
                                        href="http://www.uni.lu/lcsb"
                                        class="">http://www.uni.lu/lcsb</a></p>
                                    <p class=""><a
                                        moz-do-not-send="true"
                                        href="https://www.facebook.com/trefex"
                                        class=""><img
                                          moz-do-not-send="true"
                                          data-filename="facebook.png"
                                          alt="Facebook" class=""
                                          height="24" width="24"></a><span
                                        class="Apple-converted-space"> </span><span
                                        class="Apple-converted-space"> </span><a
                                        moz-do-not-send="true"
                                        href="https://twitter.com/Trefex"
                                        class=""><img
                                          moz-do-not-send="true"
                                          data-filename="twitter.png"
                                          alt="Twitter" class=""
                                          height="24" width="24"></a><span
                                        class="Apple-converted-space"> </span><span
                                        class="Apple-converted-space"> </span><a
                                        moz-do-not-send="true"
                                        href="https://plus.google.com/+ChristopheTrefois/"
                                        class=""><img
                                          moz-do-not-send="true"
                                          data-filename="googleplus.png"
                                          alt="Google Plus" class=""
                                          height="24" width="24"></a><span
                                        class="Apple-converted-space"> </span><span
                                        class="Apple-converted-space"> </span><a
                                        moz-do-not-send="true"
                                        href="https://www.linkedin.com/in/trefoischristophe"
                                        class=""><img
                                          moz-do-not-send="true"
                                          data-filename="linkedin.png"
                                          alt="Linkedin" class=""
                                          height="24" width="24"></a><span
                                        class="Apple-converted-space"> </span><span
                                        class="Apple-converted-space"> </span><a
                                        moz-do-not-send="true" class=""><img
                                          moz-do-not-send="true"
                                          data-filename="skype.png"
                                          alt="skype" class=""
                                          height="24" width="24"></a></p>
                                    <div class=""><br
                                        class="webkit-block-placeholder">
                                    </div>
                                    <p class="">----<br class="">
                                      This message is confidential and
                                      may contain privileged
                                      information.<span
                                        class="Apple-converted-space"> </span><br
                                        class="">
                                      It is intended for the named
                                      recipient only.<span
                                        class="Apple-converted-space"> </span><br
                                        class="">
                                      If you receive it in error please
                                      notify me and permanently delete
                                      the original message and any
                                      copies.<span
                                        class="Apple-converted-space"> </span><br
                                        class="">
                                      ----<br class="">
                                    </p>
                                     <span class="Apple-converted-space"> </span></div>
                                </div>
                              </div>
                            </div>
                            <br class="">
                            <br class="">
                            <fieldset class="mimeAttachmentHeader"></fieldset>
                            <br class="">
                          </blockquote>
                          <br class="">
                          <pre class="moz-signature" cols="72">-- 
Red Hat GmbH, <a moz-do-not-send="true" class="moz-txt-link-freetext" href="http://www.de.redhat.com/">http://www.de.redhat.com/</a>, Registered seat: Grasbrunn, 
Commercial register: Amtsgericht Muenchen, HRB 153243,
Managing Directors: Charles Cachera, Michael Cunningham, Michael O'Neill, Eric Shander</pre>
                        </div>
                        -- <br class="">
                        Manage your subscription for the Freeipa-users
                        mailing list:<br class="">
                        <a moz-do-not-send="true"
                          href="https://www.redhat.com/mailman/listinfo/freeipa-users"
                          class="">https://www.redhat.com/mailman/listinfo/freeipa-users</a><br
                          class="">
                        Go to <a moz-do-not-send="true"
                          href="http://freeipa.org" class="">http://freeipa.org</a>
                        for more info on the project</div>
                    </blockquote>
                  </div>
                  <br class="">
                </div>
              </div>
              -- <br class="">
              Manage your subscription for the Freeipa-users mailing
              list:<br class="">
              <a moz-do-not-send="true"
                href="https://www.redhat.com/mailman/listinfo/freeipa-users"
                class="">https://www.redhat.com/mailman/listinfo/freeipa-users</a><br
                class="">
              Go to <a class="moz-txt-link-freetext" href="http://freeipa.org">http://freeipa.org</a> for more info on the project</div>
          </blockquote>
        </div>
        <br class="">
      </div>
    </blockquote>
    <br>
    <pre class="moz-signature" cols="72">-- 
Red Hat GmbH, <a class="moz-txt-link-freetext" href="http://www.de.redhat.com/">http://www.de.redhat.com/</a>, Registered seat: Grasbrunn, 
Commercial register: Amtsgericht Muenchen, HRB 153243,
Managing Directors: Charles Cachera, Michael Cunningham, Michael O'Neill, Eric Shander</pre>
  </body>
</html>