can a s3 object creation event trigger an existing fargate job?

0

I have a set up where an s3 object creation event triggers a lambda and i process the file in s3 with this lambda. as the lambda has a timeout, i'm looking to see, if i can create a fargate job and have same or similar set up. such that a s3 object creation event can trigger this fargate task. I am looking for help on how to hook up the s3 object creation event and the fargate job, such that it triggers the task .

demandé il y a 2 ans2130 vues
2 réponses
0

S3 Event Notifications cannot trigger Fargate tasks.
Instead, an object creation event can be put to EventBridge, launching the Fargate task from EventBridge.

https://aws.amazon.com/jp/blogs/aws/new-use-amazon-s3-event-notifications-with-amazon-eventbridge/
https://docs.aws.amazon.com/AmazonS3/latest/userguide/EventBridge.html

profile picture
hayao-k
répondu il y a 2 ans
  • @hayao-k : thanks . how to pass on the bucket/file information when we trigger the fargate task this way. i have tried s3 object notification with lambda and in lambda , i get the bucket and key info as such in my lambda handler code -> bucket = event['Records'][0]['s3']['bucket']['name']. how to get same information in my python fargate task code?

  • @clouduser See below for examples of Event message structures. https://docs.aws.amazon.com/AmazonS3/latest/userguide/ev-events.html#ev-events-list

    Would it look something like this. bucket = event['detail']['bucket']['name'] key = event['detail']['object']['key']

0

Unlike S3 and Lambda integration, you need to use CloudWatch EventRule to integrate S3 with Fargate.

  1. Create a CloudTrail with only S3 event selector
  2. Create an EventRule on the CloudTrail to trigger Fargate
  3. You can pass the bucket and object name to Fargate by environment variable via container override
profile pictureAWS
EXPERT
répondu il y a 2 ans

Vous n'êtes pas connecté. Se connecter pour publier une réponse.

Une bonne réponse répond clairement à la question, contient des commentaires constructifs et encourage le développement professionnel de la personne qui pose la question.

Instructions pour répondre aux questions