1 Answer
- Newest
- Most votes
- Most comments
0
Are you adding the connection to the Glue job?
It's not enough to reference the table since the Glue job needs to know the connection VPC details before starting
Hi Gonzalo, I have reference the VPC details when I created the connection. (VPC id, subnet and security group) When clicking on the connection, I can see that both the crawler and the glue jobs reference this connection. The crawler is successfully connecting but the glue job is not.
Which other way is there to reference the connection VPC details from within the glue job ?
Make sure the connection is added in the job connection list
Thank you :D That helped.
Relevant content
- asked 10 months ago
- asked 25 days ago
- asked 6 months ago
- AWS OFFICIALUpdated a month ago
- AWS OFFICIALUpdated 3 years ago
- AWS OFFICIALUpdated 9 months ago
- AWS OFFICIALUpdated a year ago
Have you checked for differences in the IAM policies attached to ETL job role and the crawler role?
Hi Sausborn, I have given the crawler and the glue job the same role and so the same IAM policies... Yet the crawler is able to connect to the database with the given roles but the glue job fails.