Is it possible to ingest large-scale data from a Snowflake Enterprise-tier account (to RDS) using an AWS Glue Spark job and without using a NAT Gateway?

I want to ingest a large table from my organisation's Snowflake database into an Aurora V2 Serverless Postgresql database. I am looking at using an AWS Glue Spark job for this process. However, the Snowflake account tier we are on is not PrivateLink-enabled. We also do not want to use a NAT Gateway as the costs in the long term will be too high. Is there any way of reading directly from Snowflake using AWS Glue, without using either VPC endpoints or a NAT Gateway to route the traffic?

주제

분석

태그

AWS Glue

언어

English

turtle

질문됨 8달 전189회 조회

1개 답변

최신
최다 투표
가장 많은 댓글

이 답변이 도움이 되었나요?커뮤니티가 여러분의 지식을 활용할 수 있도록 정답을 찬성하세요.

If not using privatelink, you should be able to access it adding an internet gateway to your Glue VPC. If that's not allowed in the VPC you need for postgress, then you might need to do something more complicated like peering them.

전문가

Gonzalo Herreros

답변함 8달 전

Is it possible to ingest large-scale data from a Snowflake Enterprise-tier account (to RDS) using an AWS Glue Spark job and without using a NAT Gateway?

관련 콘텐츠