1개 답변
- 최신
- 최다 투표
- 가장 많은 댓글
0
AWS Step Functions provides a great way of orchestrating multiple Glue jobs into a coherent workflow.
Here is a workshop that shows an example on how to build a workflow using Step Functions. It provides a visual interface and can also be defined programmatically using the Amazon States Language.
You can store the state of the different Glue jobs (as flags) in DynamoDB so you can build a fully serverless data pipelines. (Glue, Step Functions and DynamoDB are all serverless).
You can also consider event-driven orchestration of the different workflows using Amazon EventBridge.
답변함 2년 전
관련 콘텐츠
- AWS 공식업데이트됨 3년 전
- AWS 공식업데이트됨 2년 전