What are the benefits when I run a Glue job inside VPC?

0

I am having a Glue job and without VPC, the job work fine. However, I want to ask:

  1. What is the benefits if I move it to be inside a VPC?
  2. If I continue use the job outside VPC, will I face security issues such as leak data, etc.?

Thank you so much!

demandé il y a 2 ans2584 vues
1 réponse
2
Réponse acceptée

Hi. That's a great question.

If you run a job outside of a VPC, the job potentially has direct access to the internet, and a rouge engineer could write code that would write data to some endpoint on the internet that is outside of your organization. There are various ways to address this risk, but one of them is to ensure the job runs on a VPC where you control all data egress.

The other common reason to use a VPC endpoint with your Glue jobs is to enable access to other resources in your VPC (like RDS servers if you need to ingest data from those), or resources on your corporate network (if you have a connection between your VPC and your corporate network).

See the IAM Policies that Control Settings Using Condition Keys in the AWS Glue documentation at the following link. This includes an example of how you can use an IAM policy to ensure that only Glue jobs that have a specific VPC connection are able to be created.

https://docs.aws.amazon.com/glue/latest/dg/using-identity-based-policies.html

All the best with your AWS Glue data engineering!

AWS
répondu il y a 2 ans
profile picture
EXPERT
vérifié il y a 10 jours
AWS
EXPERT
vérifié il y a 2 ans
  • Thank you so much for your answer.

Vous n'êtes pas connecté. Se connecter pour publier une réponse.

Une bonne réponse répond clairement à la question, contient des commentaires constructifs et encourage le développement professionnel de la personne qui pose la question.

Instructions pour répondre aux questions