- Newest
- Most votes
- Most comments
To set up a zero code ETL environment to ingest data from an API into Redshift using Lambda, here is what you can do: -Create a Lambda function using Python runtime. The function code should make an API call, parse the response and insert the data into a Redshift table. -Grant the Lambda execution role permissions to call the API, insert into Redshift and any other dependent services. -Create an API Gateway REST API and integrate it with the Lambda function using Lambda proxy integration. -Configure the API Gateway stage for public access. -Schedule the API Gateway endpoint URL using EventBridge or CloudWatch Events to trigger the Lambda function on a periodic basis.
This allows ingesting API data into Redshift in a serverless manner without having to write any ETL code. The API Gateway endpoint acts as the trigger that executes the Lambda function which fetches data and loads it into Redshift.
Thank You for assisting.
Can you kindly provide links/example to follow the setup?
Relevant content
- asked 2 months ago
- Accepted Answerasked 10 months ago
- Accepted Answerasked a year ago
- AWS OFFICIALUpdated 24 days ago
- AWS OFFICIALUpdated 2 years ago
- AWS OFFICIALUpdated a year ago
- AWS OFFICIALUpdated 3 months ago