1 Risposta
- Più recenti
- Maggior numero di voti
- Maggior numero di commenti
1
You can have multiple consumers but they share the same shard throughput of 2MB/s when provisioned.
You could add more shard to reduce the volume for each one but it's more robust to enable Fan-out reading, where readers don't compete for bandwidth.
You have to first enable it on the shard (or use on demand mode) and then configure the Glue 4 streaming job to use it:
https://docs.aws.amazon.com/glue/latest/dg/aws-glue-programming-etl-connect-kinesis-efo.html
Contenuto pertinente
- AWS UFFICIALEAggiornata 3 anni fa
- AWS UFFICIALEAggiornata un anno fa
- AWS UFFICIALEAggiornata un anno fa
- AWS UFFICIALEAggiornata 3 anni fa
are there any drawbacks of implementing this approach?
Obviously has a higher cost on the Kinesis side and it's a relatively new feature on the Glue side, so it's not as well tested as working on the default mode