[Platformone] AWS Network Issue

Fri Dec 6 01:07:46 UTC 2019

All - FYSA, Nic has an Ask Me Anything at 9:30 AM EST tomorrow and needs
the VPCs back online.

On Thu, Dec 5, 2019 at 8:02 PM Adrian Nunez <adrian.nunez at bylight.com>
wrote:

> I put the routing tables back to where they were before you emailed.  If
> Nic can hit sso.dsop.io, then the problem might be internal.  If there
> was no internet connectivity to the internet you wouldn't get sso.dsop.io
> in a browser.
>
> ------------------------------
> *From:* Jonathan Rickard <jrickard at redhat.com>
> *Sent:* Thursday, December 5, 2019 7:41 PM
>
> *To:* Adrian Nunez <adrian.nunez at bylight.com>
> *Cc:* platformONE at redhat.com <platformONE at redhat.com>; Nunez, Carlos A
> [US] (MS) (Contr) <Carlos.Nunez2 at ngc.com>
> *Subject:* Re: AWS Network Issue
>
>
> [EXTERNAL EMAIL]
> I completely agree with you - but whenever i go to https://dccscr.dsop.io
> it's dead now - and if i were to ssh into the EIP for it, it times out ...
> before you added the subnets to the peers I was able to reach them ...
>
> https:
> [image: image.png]
>
> ssh:
> [image: image.png]
>
> Jonathan Rickard, RHCA
>
> Principal Consultant, NAPS
>
> Red Hat Remote - Texas <https://www.redhat.com/>
>
> jonny at redhat.com
> M: 210-862-9739
> <https://www.redhat.com/>
>
>
> On Thu, Dec 5, 2019 at 6:36 PM Adrian Nunez <adrian.nunez at bylight.com>
> wrote:
>
> You have quad zeros on the Gitlab for 22 and 443.  You should be able to
> SSH and HTTPS in from anywhere.
>
>
> ------------------------------
> *From:* Jonathan Rickard <jrickard at redhat.com>
> *Sent:* Thursday, December 5, 2019 7:29 PM
> *To:* Adrian Nunez <adrian.nunez at bylight.com>
> *Cc:* platformONE at redhat.com <platformONE at redhat.com>; Nunez, Carlos A
> [US] (MS) (Contr) <Carlos.Nunez2 at ngc.com>
> *Subject:* Re: AWS Network Issue
>
>
> [EXTERNAL EMAIL]
> Adrian,
>
> I think that made it worse - now I can't connect to the gitlab in
> production vpc (SSH or HTTPS).
>
>
> Jonathan Rickard, RHCA
>
> Principal Consultant, NAPS
>
> Red Hat Remote - Texas <https://www.redhat.com/>
>
> jonny at redhat.com
> M: 210-862-9739
> <https://www.redhat.com/>
>
>
> On Thu, Dec 5, 2019 at 6:13 PM Adrian Nunez <adrian.nunez at bylight.com>
> wrote:
>
> Try it now.  Your peering connection didn't have subnets associated with
> it.
>
> Get Outlook for Android <https://aka.ms/ghei36>
>
> ------------------------------
> *From:* Jonathan Rickard <jrickard at redhat.com>
> *Sent:* Thursday, December 5, 2019 7:07:17 PM
> *To:* Adrian Nunez <adrian.nunez at bylight.com>
> *Cc:* platformONE at redhat.com <platformONE at redhat.com>; Nunez, Carlos A
> [US] (MS) (Contr) <Carlos.Nunez2 at ngc.com>
> *Subject:* Re: AWS Network Issue
>
>
> [EXTERNAL EMAIL]
> Sounds good - thanks Adrian ... I'm trying to figure out the syntax to
> query against a log group to see if I can catch the reason for the drop ...
>
> Even running a curl against the port is timing out (curl -v <ip>:22 ) ...
>
>
> Jonathan Rickard, RHCA
>
> Principal Consultant, NAPS
>
> Red Hat Remote - Texas <https://www.redhat.com/>
>
> jonny at redhat.com
> M: 210-862-9739
> <https://www.redhat.com/>
>
>
> On Thu, Dec 5, 2019 at 6:02 PM Adrian Nunez <adrian.nunez at bylight.com>
> wrote:
>
> Ok. I'll take a look in about 10. Eating dinner.
>
> Get Outlook for Android <https://aka.ms/ghei36>
>
> ------------------------------
> *From:* Jonathan Rickard <jrickard at redhat.com>
> *Sent:* Thursday, December 5, 2019 6:59:34 PM
> *To:* Adrian Nunez <adrian.nunez at bylight.com>
> *Cc:* platformONE at redhat.com <platformONE at redhat.com>; Nunez, Carlos A
> [US] (MS) (Contr) <Carlos.Nunez2 at ngc.com>
> *Subject:* Re: AWS Network Issue
>
>
> [EXTERNAL EMAIL]
> Yep, we checked the security groups - even tried to open it up 0.0.0.0 to
> test and got nothing.  I checked the peering and that looks good, I also
> checked the route tables and from what I can tell it all looks right.
>
> Trying to go from production-vpc to dev-up-vpc and staging-up-vpc
> (production to staging is most important ATM) ..
>
> Jonathan Rickard, RHCA
>
> Principal Consultant, NAPS
>
> Red Hat Remote - Texas <https://www.redhat.com/>
>
> jonny at redhat.com
> M: 210-862-9739
> <https://www.redhat.com/>
>
>
> On Thu, Dec 5, 2019 at 5:55 PM Adrian Nunez <adrian.nunez at bylight.com>
> wrote:
>
> Check security groups and IP addresses.
> There was talk about whitelisting IPs yesterday.
>
> Which VPCs are you trying to SSH into? I can go take a look.
>
>
>
> Get Outlook for Android <https://aka.ms/ghei36>
> ------------------------------
> *From:* Jonathan Rickard <jrickard at redhat.com>
> *Sent:* Thursday, December 5, 2019 6:51:32 PM
> *To:* Adrian Nunez <adrian.nunez at bylight.com>
> *Cc:* platformONE at redhat.com <platformONE at redhat.com>; Nunez, Carlos A
> [US] (MS) (Contr) <Carlos.Nunez2 at ngc.com>
> *Subject:* Re: AWS Network Issue
>
>
> [EXTERNAL EMAIL]
> Yah, the peering connections still look good - but we can't ssh from
> production to dev/staging environments.
>
> Jonathan Rickard, RHCA
>
> Principal Consultant, NAPS
>
> Red Hat Remote - Texas <https://www.redhat.com/>
>
> jonny at redhat.com
> M: 210-862-9739
> <https://www.redhat.com/>
>
>
> On Thu, Dec 5, 2019 at 5:49 PM Adrian Nunez <adrian.nunez at bylight.com>
> wrote:
>
> I didn't touch the VPC peering connections. I saw you guys had 2
> yesterday.
>
> Get Outlook for Android <https://aka.ms/ghei36>
>
> ------------------------------
> *From:* Jonathan Rickard <jrickard at redhat.com>
> *Sent:* Thursday, December 5, 2019 6:21:08 PM
> *To:* platformONE at redhat.com <platformONE at redhat.com>; Nunez, Carlos A
> [US] (MS) (Contr) <Carlos.Nunez2 at ngc.com>; Adrian Nunez <
> adrian.nunez at bylight.com>
> *Subject:* AWS Network Issue
>
>
> [EXTERNAL EMAIL]
> Adrian / Andrew,
>
> Are you guys aware of any changes to connectivity between prod and
> dev/staging VPCs? We're just looking into it now, but we figured we'd throw
> it out there and ask before we get too deep.
>
> Thanks,
> jonny
>
> Jonathan Rickard, RHCA
>
> Principal Consultant, NAPS
>
> Red Hat Remote - Texas <https://www.redhat.com/>
>
> jonny at redhat.com
> M: 210-862-9739
> <https://www.redhat.com/>
>
> This communication (including any attachments) may contain information
> that is proprietary, confidential or exempt from disclosure. If you are not
> the intended recipient, please note that further dissemination,
> distribution, use or copying of this communication is strictly prohibited.
> Anyone who received this message in error should notify the sender
> immediately by telephone or by return email and delete it from his or her
> computer.
>
> This communication (including any attachments) may contain information
> that is proprietary, confidential or exempt from disclosure. If you are not
> the intended recipient, please note that further dissemination,
> distribution, use or copying of this communication is strictly prohibited.
> Anyone who received this message in error should notify the sender
> immediately by telephone or by return email and delete it from his or her
> computer.
>
> This communication (including any attachments) may contain information
> that is proprietary, confidential or exempt from disclosure. If you are not
> the intended recipient, please note that further dissemination,
> distribution, use or copying of this communication is strictly prohibited.
> Anyone who received this message in error should notify the sender
> immediately by telephone or by return email and delete it from his or her
> computer.
>
> This communication (including any attachments) may contain information
> that is proprietary, confidential or exempt from disclosure. If you are not
> the intended recipient, please note that further dissemination,
> distribution, use or copying of this communication is strictly prohibited.
> Anyone who received this message in error should notify the sender
> immediately by telephone or by return email and delete it from his or her
> computer.
>
> This communication (including any attachments) may contain information
> that is proprietary, confidential or exempt from disclosure. If you are not
> the intended recipient, please note that further dissemination,
> distribution, use or copying of this communication is strictly prohibited.
> Anyone who received this message in error should notify the sender
> immediately by telephone or by return email and delete it from his or her
> computer.
>
> This communication (including any attachments) may contain information
> that is proprietary, confidential or exempt from disclosure. If you are not
> the intended recipient, please note that further dissemination,
> distribution, use or copying of this communication is strictly prohibited.
> Anyone who received this message in error should notify the sender
> immediately by telephone or by return email and delete it from his or her
> computer.
> _______________________________________________
> platformONE mailing list
> platformONE at redhat.com
> https://www.redhat.com/mailman/listinfo/platformone
>
-- 

Brenna Gordon

Client Manager, NAPS

Red Hat <https://www.redhat.com/>

bgordon at redhat.com
M: 703-650-8755
<https://www.redhat.com/>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://listman.redhat.com/archives/platformone/attachments/20191205/25e20fb1/attachment.htm>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image.png
Type: image/png
Size: 108107 bytes
Desc: not available
URL: <http://listman.redhat.com/archives/platformone/attachments/20191205/25e20fb1/attachment.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image.png
Type: image/png
Size: 101111 bytes
Desc: not available
URL: <http://listman.redhat.com/archives/platformone/attachments/20191205/25e20fb1/attachment-0001.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image.png
Type: image/png
Size: 67330 bytes
Desc: not available
URL: <http://listman.redhat.com/archives/platformone/attachments/20191205/25e20fb1/attachment-0002.png>