EventBridge Scheduler targeting SQS FIFO queues is useless for rates less than 5 minutes

0

Can someone please confirm that I am understanding this correctly?

  1. GOAL: Use Event Bridge Scheduler to target an SQS FIFO queue at a rate of every 1 minute.
  2. Based on this (https://docs.aws.amazon.com/scheduler/latest/APIReference/API_SqsParameters.html), the first paragraph states: "If you specify an Amazon SQS FIFO queue as a target, the queue must have content-based deduplication enabled."
  3. Based on this (https://docs.aws.amazon.com/AWSSimpleQueueService/latest/SQSDeveloperGuide/FIFO-queues-exactly-once-processing.html), the deduplication interval is hard-coded to 5 minutes.

My understanding then is that 4 out of 5 of the attempts to queue the message will fail silently as "accepted but duplicate".

asked 8 months ago547 views
1 Answer
0

The evens that EventBridge Scheduler pushes to the queue are different every minute, so there will not be deduplication.

See the following two events. You can see that there is a different id as well as a different time field:

{"version":"0","id":"1164d9e9-31a8-419f-b38e-5a1d803fce6e","detail-type":"Scheduled Event","source":"aws.scheduler","account":"XXXX","time":"2023-08-14T08:43:29Z","region":"eu-west-1","resources":["arn:aws:scheduler:eu-west-1:XXXX:schedule/default/Fifo"],"detail":"{}"}

{"version":"0","id":"1164d9e9-6da8-419f-b38e-5a1d803fce6e","detail-type":"Scheduled Event","source":"aws.scheduler","account":"XXXX","time":"2023-08-14T08:44:29Z","region":"eu-west-1","resources":["arn:aws:scheduler:eu-west-1:XXXX:schedule/default/Fifo"],"detail":"{}"}
profile pictureAWS
EXPERT
Uri
answered 8 months ago
  • That is not correct. For Scheduler, the "message body" is static text.

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions