<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<!--[if !mso]><style>v\:* {behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}
</style><![endif]--><style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Consolas;
panose-1:2 11 6 9 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
code
{mso-style-priority:99;
font-family:"Courier New";}
pre
{mso-style-priority:99;
mso-style-link:"HTML Preformatted Char";
margin:0in;
margin-bottom:.0001pt;
font-size:10.0pt;
font-family:"Courier New";}
p.msonormal0, li.msonormal0, div.msonormal0
{mso-style-name:msonormal;
mso-margin-top-alt:auto;
margin-right:0in;
mso-margin-bottom-alt:auto;
margin-left:0in;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
span.HTMLPreformattedChar
{mso-style-name:"HTML Preformatted Char";
mso-style-priority:99;
mso-style-link:"HTML Preformatted";
font-family:"Consolas",serif;}
span.EmailStyle22
{mso-style-type:personal-reply;
font-family:"Calibri",sans-serif;
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-US" link="blue" vlink="purple">
<div class="WordSection1">
<p class="MsoNormal">Any updates on the cluster? We are blocked.<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<div style="border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b><span style="font-size:12.0pt;color:black">From: </span></b><span style="font-size:12.0pt;color:black">Jonathan Rickard <jrickard@redhat.com><br>
<b>Date: </b>Monday, December 16, 2019 at 11:47 AM<br>
<b>To: </b>"Starling, Jennifer [MERIDIAN TECHNOLOGIES I, LLC]" <jennifer.starling@accenturefederal.com><br>
<b>Cc: </b>"platformONE@redhat.com" <platformONE@redhat.com>, "Jared Crace [Mantech]" <Jared.Crace@mantech.com>, "Joseph Middleton (Confluence)" <confluence-noreply@di2e.net>, "Mark Sanchez [Gov]" <mark.sanchez.8@us.af.mil><br>
<b>Subject: </b>[External] Re: [Platformone] cluster issue submitted - pod will not deploy - taint errors<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal" align="center" style="text-align:center"><span style="font-size:10.5pt;font-family:"Arial",sans-serif;color:red">This message is from an EXTERNAL SENDER - be CAUTIOUS of links and attachments. THINK BEFORE YOU CLICK.<o:p></o:p></span></p>
<div class="MsoNormal" align="center" style="text-align:center">
<hr size="0" width="100%" align="center">
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<div>
<p class="MsoNormal">Jennifer, <o:p></o:p></p>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">Thank you for providing this information. We are actively engaged to restore service to the cluster. FYI, the issue is related to the number of devices attached to each of the instances. <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">jonny<br clear="all">
<o:p></o:p></p>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<p style="margin:0in;margin-bottom:.0001pt"><b><span style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black">Jonathan Rickard</span></b><b><span style="font-size:10.5pt;font-family:"Arial",sans-serif;color:#AAAAAA;text-transform:uppercase">, RHCE,
RHCA</span></b><b><span style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black"><o:p></o:p></span></b></p>
<p style="margin:0in;margin-bottom:.0001pt"><span style="font-size:9.0pt;font-family:"Arial",sans-serif;color:black">Consulting Architect<o:p></o:p></span></p>
<p style="margin:0in;margin-bottom:.0001pt"><span style="font-size:9.0pt;font-family:"Arial",sans-serif;color:black"><a href="https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.redhat.com%2F&data=02%7C01%7Cjennifer.starling%40accenturefederal.com%7C73955b2ce8cd419319e708d7824ff5ea%7C0ee6c63b4eab4748b74ad1dc22fc1a24%7C0%7C0%7C637121152254352180&sdata=lHLkrMLT1G71rcwXnPrmts1qkPdcVxUoihGo64JJj%2Bg%3D&reserved=0" target="_blank"><span style="color:#0088CE">Red
Hat Public Sector</span></a><o:p></o:p></span></p>
<p style="margin:0in;margin-bottom:.0001pt"><span style="font-size:9.0pt;font-family:"Arial",sans-serif;color:black"><a href="mailto:jonny@redhat.com" target="_blank"><span style="color:black">jonny@redhat.com</span></a> <br>
M: <a href="tel:210.862.9739" target="_blank"><span style="color:black">210.862.9739</span></a> <o:p></o:p></span></p>
<div style="margin-bottom:6.0pt">
<div>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Arial",sans-serif;color:black"><a href="https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Ftwitter.com%2Fredhatjobs&data=02%7C01%7Cjennifer.starling%40accenturefederal.com%7C73955b2ce8cd419319e708d7824ff5ea%7C0ee6c63b4eab4748b74ad1dc22fc1a24%7C0%7C0%7C637121152254362180&sdata=R9%2F3y7vNpXH1b0vjme%2BgNKH74ACjyK6HXKYmIWYmtB0%3D&reserved=0" target="_blank" title="twitter"><span style="color:black">@redhatjobs</span></a> <a href="https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.facebook.com%2Fredhatjobs&data=02%7C01%7Cjennifer.starling%40accenturefederal.com%7C73955b2ce8cd419319e708d7824ff5ea%7C0ee6c63b4eab4748b74ad1dc22fc1a24%7C0%7C0%7C637121152254362180&sdata=jXMoBDRVdI2QRfrQEEqw1XaRm5QUKCz31PSPZauMwH0%3D&reserved=0" target="_blank" title="Facebook"><span style="color:black">redhatjobs</span></a> <a href="https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Finstagram.com%2Fredhatjobs&data=02%7C01%7Cjennifer.starling%40accenturefederal.com%7C73955b2ce8cd419319e708d7824ff5ea%7C0ee6c63b4eab4748b74ad1dc22fc1a24%7C0%7C0%7C637121152254372165&sdata=bZjZ92txm%2FyNsoMxA6eQOuN74yAy4Q3allXbNHXR85w%3D&reserved=0" target="_blank" title="instagram"><span style="color:black">@redhatjobs</span></a> <o:p></o:p></span></p>
</div>
</div>
<div style="margin-top:9.0pt">
<table class="MsoNormalTable" border="0" cellpadding="0">
<tbody>
<tr>
<td style="padding:.75pt .75pt .75pt .75pt">
<p class="MsoNormal"><a href="https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.redhat.com%2F&data=02%7C01%7Cjennifer.starling%40accenturefederal.com%7C73955b2ce8cd419319e708d7824ff5ea%7C0ee6c63b4eab4748b74ad1dc22fc1a24%7C0%7C0%7C637121152254372165&sdata=Xaixdi8nCmOkHVaRCsEeEn7isz%2BKE1gj7Sgn4t1oq84%3D&reserved=0" target="_blank"><span style="color:windowtext;text-decoration:none"><span style="color:blue;border:solid windowtext 1.0pt;padding:0in"><img border="0" width="90" height="90" style="width:.9375in;height:.9375in" id="_x0000_i1025" src="cid:~WRD087.jpg" alt="Image removed by sender."></span></span></a><o:p></o:p></p>
</td>
</tr>
</tbody>
</table>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<div>
<p class="MsoNormal">On Mon, Dec 16, 2019 at 10:39 AM Starling, Jennifer [MERIDIAN TECHNOLOGIES I, LLC] <<a href="mailto:jennifer.starling@accenturefederal.com" target="_blank">jennifer.starling@accenturefederal.com</a>> wrote:<o:p></o:p></p>
</div>
<blockquote style="border:none;border-left:solid #CCCCCC 1.0pt;padding:0in 0in 0in 6.0pt;margin-left:4.8pt;margin-right:0in">
<div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">I submitted an issue.
<a href="https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdccscr.dsop.io%2Funified-platform-node-aam%2Fmisp-images%2Fissues%2F1&data=02%7C01%7Cjennifer.starling%40accenturefederal.com%7C73955b2ce8cd419319e708d7824ff5ea%7C0ee6c63b4eab4748b74ad1dc22fc1a24%7C0%7C0%7C637121152254382159&sdata=LBFbTTEvUNSdFyQ30DY1MlxBmBjA7CGX7uRYpsZM39U%3D&reserved=0" target="_blank">
https://dccscr.dsop.io/unified-platform-node-aam/misp-images/issues/1</a><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">I do not know how to make it a blocker, but it is a blocker. When this happens, we cannot create new pods or re-deploy in any projects.<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">Thank you for your assistance, Please let me know if you require further information.<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">Jen…<o:p></o:p></p>
<p>Our pod is getting errors about taint. <a href="https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fcluster.unified-platform.io%2Fconsole%2Fproject%2Fsaml-auth-proto-misp-app%2Fbrowse%2Fevents&data=02%7C01%7Cjennifer.starling%40accenturefederal.com%7C73955b2ce8cd419319e708d7824ff5ea%7C0ee6c63b4eab4748b74ad1dc22fc1a24%7C0%7C0%7C637121152254382159&sdata=NdDpMZM8AIUS%2FiEIffSr5aLqs1DrKpYQ0yTRjWi3Y%2Fo%3D&reserved=0" target="_blank">
https://cluster.unified-platform.io/console/project/saml-auth-proto-misp-app/browse/events</a><o:p></o:p></p>
<p>cluster: <a href="https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fcluster.unified-platform.io&data=02%7C01%7Cjennifer.starling%40accenturefederal.com%7C73955b2ce8cd419319e708d7824ff5ea%7C0ee6c63b4eab4748b74ad1dc22fc1a24%7C0%7C0%7C637121152254382159&sdata=Ab%2FmwWajBP4%2BMXgcfgvgR7CBSGxC%2BaEiuihXClKaFAc%3D&reserved=0" target="_blank">
https://cluster.unified-platform.io</a> project: saml-auth-proto-misp-app<o:p></o:p></p>
<p>I verified the image exists. It was running and then we tried to re-deploy it. Once one of the pods gets in this state we cannot start up any new pods even in other projects.<o:p></o:p></p>
<pre>10:28:11 AM saml-auth-proto-misp-app-web-2-deploy Pod Warning Failed Scheduling 0/9 nodes are available: 3 node(s) had taints that the pod didn't tolerate, 6 node(s) didn't match node selector.<o:p></o:p></pre>
<pre>6021 times in the last 2 hours<o:p></o:p></pre>
<pre>10:26:15 AM rf-domain-sync-1576224000-jxqvt Pod Normal Pulling pulling image "docker-registry.default.svc:5000/saml-auth-proto-misp-app/saml-auth-proto-misp-app-rf-feed-image:latest"<o:p></o:p></pre>
<pre>4132 times in the last 3 days<o:p></o:p></pre>
<pre>10:26:04 AM rf-domain-sync-1576224000-jxqvt Pod Warning Failed Error: ErrImagePull<o:p></o:p></pre>
<pre>106 times in the last 2 days<o:p></o:p></pre>
<pre>10:26:04 AM rf-domain-sync-1576224000-jxqvt Pod Warning Failed Failed to pull image "docker-registry.default.svc:5000/saml-auth-proto-misp-app/saml-auth-proto-misp-app-rf-feed-image:latest": rpc error: code = Unknown desc = Get <a href="https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocker-registry.default.svc%3A5000%2Fv2%2Fsaml-auth-proto-misp-app%2Fsaml-auth-proto-misp-app-rf-feed-image%2Fmanifests%2Flatest&data=02%7C01%7Cjennifer.starling%40accenturefederal.com%7C73955b2ce8cd419319e708d7824ff5ea%7C0ee6c63b4eab4748b74ad1dc22fc1a24%7C0%7C0%7C637121152254392156&sdata=AGBd87JIKPUu%2BaLrl3K3Trzonx8VE50IE2q6EaW4xH8%3D&reserved=0" target="_blank">https://docker-registry.default.svc:5000/v2/saml-auth-proto-misp-app/saml-auth-proto-misp-app-rf-feed-image/manifests/latest</a>: Get <a href="https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocker-registry.default.svc%3A5000%2Fopenshift%2Ftoken%3Faccount%3Dserviceaccount%26scope%3Drepository%253Asaml-auth-proto-misp-app%252Fsaml-auth-proto-misp-app-rf-feed-image%253Apull&data=02%7C01%7Cjennifer.starling%40accenturefederal.com%7C73955b2ce8cd419319e708d7824ff5ea%7C0ee6c63b4eab4748b74ad1dc22fc1a24%7C0%7C0%7C637121152254392156&sdata=3Cajr3s00v38E1PXAe8bK%2BPL5IJIK%2FQ8JphDoA3vC%2F0%3D&reserved=0" target="_blank">https://docker-registry.default.svc:5000/openshift/token?account=serviceaccount&scope=repository%3Asaml-auth-proto-misp-app%2Fsaml-auth-proto-misp-app-rf-feed-image%3Apull</a>: net/http: request canceled (Client.Timeout exceeded while awaiting headers)<o:p></o:p></pre>
<pre>41 times in the last 15 hours<o:p></o:p></pre>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
</div>
</div>
<p class="MsoNormal">_______________________________________________<br>
platformONE mailing list<br>
<a href="mailto:platformONE@redhat.com" target="_blank">platformONE@redhat.com</a><br>
<a href="https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.redhat.com%2Fmailman%2Flistinfo%2Fplatformone&data=02%7C01%7Cjennifer.starling%40accenturefederal.com%7C73955b2ce8cd419319e708d7824ff5ea%7C0ee6c63b4eab4748b74ad1dc22fc1a24%7C0%7C0%7C637121152254402150&sdata=W1zrusWHBzqs1XjrGQvO3LaAKDtenmjyj5b5UIZVhpc%3D&reserved=0" target="_blank">https://www.redhat.com/mailman/listinfo/platformone</a><o:p></o:p></p>
</blockquote>
</div>
</div>
</div>
</body>
</html>