<html xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Title" content="">
<meta name="Keywords" content="">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:宋体;}
@font-face
{font-family:"Cordia New";
panose-1:2 11 3 4 2 2 2 2 2 4;}
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:Calibri;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:#0563C1;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:#954F72;
text-decoration:underline;}
span.EmailStyle17
{mso-style-type:personal-compose;
font-family:Calibri;
color:windowtext;}
span.msoIns
{mso-style-type:export-only;
mso-style-name:"";
text-decoration:underline;
color:teal;}
.MsoChpDefault
{mso-style-type:export-only;
font-family:Calibri;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style>
</head>
<body bgcolor="white" lang="EN-US" link="#0563C1" vlink="#954F72">
<div class="WordSection1">
<p class="MsoNormal"><span style="font-size:11.0pt">Every day or so one of my masters hangs. The processes is still running no errors in the logs, the tcp port is still listening but it’s not fulling requests. This also hangs any machines querying from the
host as the sssd timeout doesn’t seem to take affect during the tcp connection. From looking through the archives and troubleshooting docs I’ve taken a stack trace, but I can’t make heads or tails of what it means. I was hoping someone here could review
it and tell me perhaps where I should be looking.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">Stack Trace: <a href="https://dl.dropboxusercontent.com/u/13113270/stacktrace.1485223167.txt">https://dl.dropboxusercontent.com/u/13113270/stacktrace.1485223167.txt</a><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt"> <o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">Using FreeIPA 4.4<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">[<a href="mailto:root@ipa-dc1.core2">root@ipa-dc1.core2</a>]# rpm -qa |grep ipa-server<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">ipa-server-4.4.0-14.el7.centos.1.1.x86_64<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">ipa-server-common-4.4.0-14.el7.centos.1.1.noarch<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">[<a href="mailto:root@ipa-dc1.core2">root@ipa-dc1.core2</a>]# rpm -qa |grep 389-ds<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="ES-US" style="font-size:11.0pt">389-ds-base-snmp-1.3.5.10-12.el7_3.x86_64<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="ES-US" style="font-size:11.0pt">389-ds-base-debuginfo-1.3.5.10-12.el7_3.x86_64<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="ES-US" style="font-size:11.0pt">389-ds-base-libs-1.3.5.10-12.el7_3.x86_64<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="IT" style="font-size:11.0pt">389-ds-base-1.3.5.10-12.el7_3.x86_64<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="IT" style="font-size:11.0pt">[<a href="mailto:root@ipa-dc1.core2">root@ipa-dc1.core2</a>]# uname -a<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="IT" style="font-size:11.0pt">Linux ipa-dc1.core2.cloud.cheggnet.com 3.10.0-123.8.1.el7.x86_64 #1 SMP Mon Sep 22 19:06:58 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="IT" style="font-size:11.0pt"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">In addition I’ve also noticed I have ghost replicas {15,24,13} which I can’t seem to remove and a high number of changes not sure if this is normal.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">[<a href="mailto:root@ipa-dc1.core2">root@ipa-dc1.core2</a>]# ldapsearch -xLLL -H ldap://localhost -D "cn=directory manager" -b dc=randomnet,dc=com '(&(nsuniqueid=ffffffff-ffffffff-ffffffff-ffffffff)(objectclass=nstombstone))'
nscpentrywsi<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">dn: cn=replica,cn=dc\3Drandomnet\2Cdc\3Dcom,cn=mapping tree,cn=config<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">nscpentrywsi: dn: cn=replica,cn=dc\3Drandomnet\2Cdc\3Dcom,cn=mapping tree,cn=config<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">nscpentrywsi: cn: replica<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">nscpentrywsi: createTimestamp: 20170113010933Z<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">nscpentrywsi: creatorsName: cn=Directory Manager<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">nscpentrywsi: modifiersName: cn=Multimaster Replication Plugin,cn=plugins,cn=config<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">nscpentrywsi: modifyTimestamp: 20170124195814Z<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">nscpentrywsi: nsDS5Flags: 1<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">nscpentrywsi: nsDS5ReplicaBindDN: cn=replication manager,cn=config<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">nscpentrywsi: nsDS5ReplicaBindDN: …<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">nscpentrywsi: nsDS5ReplicaId: 28<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">nscpentrywsi: nsDS5ReplicaName: f135c48c-d92c11e6-ba4cb212-9904938c<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">nscpentrywsi: nsDS5ReplicaRoot: dc=randomnet,dc=com<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">nscpentrywsi: nsDS5ReplicaType: 3<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">nscpentrywsi: nsState:: HAAAAAAAAADLsYdYAAAAAAEAAAAAAAAAuwAAAAAAAAAKAAAAAAAAAA<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">==<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">nscpentrywsi: nsds5ReplicaLegacyConsumer: off<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">nscpentrywsi: nsds5replicabinddngroup: cn=replication managers,cn=sysaccounts,cn=etc,dc=randomnet,dc=com<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">nscpentrywsi: nsds5replicabinddngroupcheckinterval: 60<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">nscpentrywsi: objectClass: nsds5replica<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">nscpentrywsi: objectClass: top<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">nscpentrywsi: objectClass: extensibleobject<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">nscpentrywsi: numSubordinates: 3<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">nscpentrywsi: nsds50ruv: {replicageneration} 564e51c0000000040000<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">nscpentrywsi: nsds50ruv: {replica 28 ldap://ipa-dc1.core2.cloud.RANDOMNET.COM:389} 587829930000001c0000 5887b2780018001c0000<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">nscpentrywsi: nsds50ruv: {replica 17 ldap://ipa.RANDOMNET.COM:389} 57ec1b37000000110000 5887b2c6000c00110000<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">nscpentrywsi: nsds50ruv: {replica 22 ldap://ipa-dc03.core2.cloud.RANDOMNET.COM:389} 5818c9ac000100160000 58877a26000100160000<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">nscpentrywsi: nsds50ruv: {replica 9 ldap://ipa-dc2.core2.cloud.RANDOMNET.COM:389} 56c57637000000090000 58878ffe000600090000<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">nscpentrywsi: nsds50ruv: {replica 27 ldap://ipa-dc02.corp1.cloud.RANDOMNET.COM:389} 587747710000001b0000 5877d75c0009001b0000<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">nscpentrywsi: nsds50ruv: {replica 29 ldap://ipa-dc01.test3.cloud.RANDOMNET.COM:389} 5878372a0000001d0000 588795e20001001d0000<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">nscpentrywsi: nsds50ruv: {replica 30 ldap://ipa-dc02.test3.cloud.RANDOMNET.COM:389} 58783e2d0000001e0000 588799c50003001e0000<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">nscpentrywsi: nsds50ruv: {replica 15} 5875c4330002000f0000 587836f20009000f0000<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">nscpentrywsi: nsds50ruv: {replica 24} 5877d808000500180000 58781d6a000500180000<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">nscpentrywsi: nsds50ruv: {replica 13} 581802c70000000d0000 581802c70000000d0000<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">nscpentrywsi: nsds5agmtmaxcsn: dc=randomnet,dc=com;ipa-dc1.core2.cloud.randomnet.com-to-ipa-dc03.core2.cloud.RANDOMNET.COM;ipa-dc03.core2.cloud.RANDOMNET.COM;389;22;588778510002001c0000<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">nscpentrywsi: nsds5agmtmaxcsn: dc=randomnet,dc=com;ipa-dc1.core2.cloud.randomnet.com-to-ipa-dc2.core2.cloud.RANDOMNET.COM;ipa-dc2.core2.cloud.RANDOMNET.COM;389;9;588778510002001c0000<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">nscpentrywsi: nsds5agmtmaxcsn: dc=randomnet,dc=com;ipa-dc1.core2.cloud.randomnet.com-to-ipa.RANDOMNET.COM;ipa.RANDOMNET.COM;389;17;588778510002001c0000<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">nscpentrywsi: nsruvReplicaLastModified: {replica 28 ldap://ipa-dc1.core2.cloud.RANDOMNET.COM:389} 5887b1bc<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">nscpentrywsi: nsruvReplicaLastModified: {replica 17 ldap://ipa.RANDOMNET.COM:389} 5887b20d<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">nscpentrywsi: nsruvReplicaLastModified: {replica 22 ldap://ipa-dc03.core2.cloud.RANDOMNET.COM:389} 5887796c<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">nscpentrywsi: nsruvReplicaLastModified: {replica 9 ldap://ipa-dc2.core2.cloud.RANDOMNET.COM:389} 58878f46<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">nscpentrywsi: nsruvReplicaLastModified: {replica 27 ldap://ipa-dc02.corp1.cloud.RANDOMNET.COM:389} 00000000<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">nscpentrywsi: nsruvReplicaLastModified: {replica 29 ldap://ipa-dc01.test3.cloud.RANDOMNET.COM:389} 58879526<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">nscpentrywsi: nsruvReplicaLastModified: {replica 30 ldap://ipa-dc02.test3.cloud.RANDOMNET.COM:389} 5887990a<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">nscpentrywsi: nsruvReplicaLastModified: {replica 15} 00000000<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">nscpentrywsi: nsruvReplicaLastModified: {replica 24} 00000000<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">nscpentrywsi: nsruvReplicaLastModified: {replica 13} 00000000<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">nscpentrywsi: nsds5ReplicaChangeCount: 58090<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">nscpentrywsi: nsds5replicareapactive: 0<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt"><o:p> </o:p></span></p>
</div>
</body>
</html>