AWS Glue job timeout when attempting HTTP to a glue api

0

I'm building a glue job for a data migration with schema changes and mappings between two RDS postgres DBs.

I'm getting an error connecting to glue apis.

AnalysisException: org.apache.hadoop.hive.ql.metadata.HiveException: com.amazonaws.SdkClientException: Unable to execute HTTP request: Connect to glue.eu-central-1.amazonaws.com:443 [glue.eu-central-1.amazonaws.com/3.67.142.3, glue.eu-central-1.amazonaws.com/35.158.201.117, glue.eu-central-1.amazonaws.com/52.57.253.25, glue.eu-central-1.amazonaws.com/52.28.109.221, glue.eu-central-1.amazonaws.com/18.158.248.119, glue.eu-central-1.amazonaws.com/3.124.130.34, glue.eu-central-1.amazonaws.com/18.158.243.101, glue.eu-central-1.amazonaws.com/18.192.226.225] failed: connect timed out

I've had a previous job working properly using the same iam role, so I'm not sure where to look to fix the issue. Appreciating any insights.

asked 10 months ago273 views
1 Answer
1
Accepted Answer

Add a Glue endpoint on your VPC, so you can use the catalog APIs
If it was working before maybe you were running on a VPC with internet access or no VPC at all.

profile pictureAWS
EXPERT
answered 10 months ago
  • Thanks. It seems to have fixed the error.

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions