Deploy Multiple Glue Jobs(100+) using CodeDeploy and Not Time dependent.

0

Hi Team,

I have a query -- How can I do multiple deployments of glue jobs(100+) with different scripts from same pipeline and assign them different Job names?

I have made a CFT for cross-account deployment using Codepipeline, and I'm able to successfully deploy a single glue job. But for the next phase in our project, we need to deploy multiple glue jobs with different scripts and they are not time-dependent.

Like a developer pushed his code on 7th Feb, and another developer on 18th Feb like this there can be 100+ such jobs and each job must have different names. And also, deployment of another glue job should not affect the previous ones unless there is a change in the Native script.

So, how can I achieve this type of deployment?

  • Have you considered AWS Cloud Development Kit (AWS CDK) for your deployment needs? Using CDK, you could create reusable CDK construct libraries using common programming languages. This approach would be ideal in your case with multiple developers committing code.

  • Hey @knamburi, haven't considered it yet!! Can you share some DOCs for this?

    I have my cft for cross-pipeline ready.

  • Hi Garvit,

    1. Please find CDK AWS developer guide here. This will help you get started : https://docs.aws.amazon.com/cdk/v2/guide/home.html.

    2. Sample code is available for your reference that helps accelerate your IAC pipeline https://github.com/aws-samples/aws-glue-cdk-cicd

질문됨 일 년 전113회 조회
답변 없음

로그인하지 않았습니다. 로그인해야 답변을 게시할 수 있습니다.

좋은 답변은 질문에 명확하게 답하고 건설적인 피드백을 제공하며 질문자의 전문적인 성장을 장려합니다.

질문 답변하기에 대한 가이드라인

관련 콘텐츠