I would like to build simple solution S3 - AMAZON Glue - AMAZON Redshift - Tableaue, but can't do it for different reasons...
how to fix this to execute Jobs from Amazon Glue to Redshift? Error: "JobName:s3-redshift and JobRunId:jr_30d8ac0c6b35d44f641b7d5b55819365897b18e6244c8a5559bff53efc8e23c1 failed to execute with exception At least one security group must open all egress ports.To limit traffic, the source security group in your outbound rule can be restricted to the same security group (Service: AWSGlueJobExecutor; Status Code: 400; Error Code: InvalidInputException; Request ID: eafb6d33-21d0-438c-96b9-c7b7ea6162f9; Proxy: null)", I updated my security group inbound rules - but nothing happens. What I need to do in this case?
- 최신
- 최다 투표
- 가장 많은 댓글
You need to update the inbound AND outbound rules of the security group. Important: You probably do not need to open it to world (ie do NOT open it to 0.0.0.0/0), but have as a source always the security group itself (ie all compute that is assigned to the security group can talk with each other). Make sure also that the security group is assigned to a Glue connection (if you use Glue) of type network and that the connection is assigned to the Glue job.
As mentioned in the previous answer there might be additional steps that need to be done:
- the security group are configured on all components , refer to [this page in the documentation[(https://docs.aws.amazon.com/glue/latest/dg/setup-vpc-for-glue-access.html)
- check also this blog for additional configuration
- check the Redshift connection is properly setup (when you test the connection does it complete succesfully or it still fails?
hope this helps
