1 Risposta
- Più recenti
- Maggior numero di voti
- Maggior numero di commenti
0
AWS Step Functions provides a great way of orchestrating multiple Glue jobs into a coherent workflow.
Here is a workshop that shows an example on how to build a workflow using Step Functions. It provides a visual interface and can also be defined programmatically using the Amazon States Language.
You can store the state of the different Glue jobs (as flags) in DynamoDB so you can build a fully serverless data pipelines. (Glue, Step Functions and DynamoDB are all serverless).
You can also consider event-driven orchestration of the different workflows using Amazon EventBridge.
con risposta 2 anni fa
Contenuto pertinente
- AWS UFFICIALEAggiornata 2 anni fa
- AWS UFFICIALEAggiornata 2 anni fa
- AWS UFFICIALEAggiornata 3 anni fa