can a s3 object creation event trigger an existing fargate job?

0

I have a set up where an s3 object creation event triggers a lambda and i process the file in s3 with this lambda. as the lambda has a timeout, i'm looking to see, if i can create a fargate job and have same or similar set up. such that a s3 object creation event can trigger this fargate task. I am looking for help on how to hook up the s3 object creation event and the fargate job, such that it triggers the task .

posta 2 anni fa2130 visualizzazioni
2 Risposte
0

S3 Event Notifications cannot trigger Fargate tasks.
Instead, an object creation event can be put to EventBridge, launching the Fargate task from EventBridge.

https://aws.amazon.com/jp/blogs/aws/new-use-amazon-s3-event-notifications-with-amazon-eventbridge/
https://docs.aws.amazon.com/AmazonS3/latest/userguide/EventBridge.html

profile picture
hayao-k
con risposta 2 anni fa
  • @hayao-k : thanks . how to pass on the bucket/file information when we trigger the fargate task this way. i have tried s3 object notification with lambda and in lambda , i get the bucket and key info as such in my lambda handler code -> bucket = event['Records'][0]['s3']['bucket']['name']. how to get same information in my python fargate task code?

  • @clouduser See below for examples of Event message structures. https://docs.aws.amazon.com/AmazonS3/latest/userguide/ev-events.html#ev-events-list

    Would it look something like this. bucket = event['detail']['bucket']['name'] key = event['detail']['object']['key']

0

Unlike S3 and Lambda integration, you need to use CloudWatch EventRule to integrate S3 with Fargate.

  1. Create a CloudTrail with only S3 event selector
  2. Create an EventRule on the CloudTrail to trigger Fargate
  3. You can pass the bucket and object name to Fargate by environment variable via container override
profile pictureAWS
ESPERTO
con risposta 2 anni fa

Accesso non effettuato. Accedi per postare una risposta.

Una buona risposta soddisfa chiaramente la domanda, fornisce un feedback costruttivo e incoraggia la crescita professionale del richiedente.

Linee guida per rispondere alle domande