can a s3 object creation event trigger an existing fargate job?

0

I have a set up where an s3 object creation event triggers a lambda and i process the file in s3 with this lambda. as the lambda has a timeout, i'm looking to see, if i can create a fargate job and have same or similar set up. such that a s3 object creation event can trigger this fargate task. I am looking for help on how to hook up the s3 object creation event and the fargate job, such that it triggers the task .

asked 2 years ago1986 views
2 Answers
0

S3 Event Notifications cannot trigger Fargate tasks.
Instead, an object creation event can be put to EventBridge, launching the Fargate task from EventBridge.

https://aws.amazon.com/jp/blogs/aws/new-use-amazon-s3-event-notifications-with-amazon-eventbridge/
https://docs.aws.amazon.com/AmazonS3/latest/userguide/EventBridge.html

profile picture
hayao-k
answered 2 years ago
  • @hayao-k : thanks . how to pass on the bucket/file information when we trigger the fargate task this way. i have tried s3 object notification with lambda and in lambda , i get the bucket and key info as such in my lambda handler code -> bucket = event['Records'][0]['s3']['bucket']['name']. how to get same information in my python fargate task code?

  • @clouduser See below for examples of Event message structures. https://docs.aws.amazon.com/AmazonS3/latest/userguide/ev-events.html#ev-events-list

    Would it look something like this. bucket = event['detail']['bucket']['name'] key = event['detail']['object']['key']

0

Unlike S3 and Lambda integration, you need to use CloudWatch EventRule to integrate S3 with Fargate.

  1. Create a CloudTrail with only S3 event selector
  2. Create an EventRule on the CloudTrail to trigger Fargate
  3. You can pass the bucket and object name to Fargate by environment variable via container override
profile pictureAWS
EXPERT
answered 2 years ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions