AWS re:Postを使用することにより、以下に同意したことになります AWS re:Post 利用規約
AWS re:Postre:Post

how to configure ideal value for MaxConcurrentTransforms in setting up a sagemaker batch transform ?

0

based on the documentation , https://docs.aws.amazon.com/sagemaker/latest/dg/batch-transform.html, it states that " The ideal value for MaxConcurrentTransforms is equal to the number of compute workers in the batch transform job." how to figure out what the number of compute workers is , i assume this depends on the instance type. also what about the instance count parameter we can set , do we have to take that into account as well?

トピック
計算する機械学習と AI
タグ
ハイパフォーマンスコンピューティングAmazon SageMaker機械学習と AI
言語
English
clouduser
質問済み 2年前833ビュー
1回答
1
承認された回答

The ideal value for MaxConcurrentTransforms varies based on instance type as well as based on your specific model.

it could make sense to increase MaxConcurrentTransforms up to the core count of the instance you are using (for cpu based transform), however, you should also take into account the memory utilisation by your model.

The ultimate answer is it "depends" and I would recommend that you experiment with increasing this number gradually from 1 up to instance core count, while monitoring RAM/cpu utilisation to find the optimal.

AWS
georgios_s
回答済み 2年前
  • clouduser
    2年前

    @georgios_s - thanks . You pointed out instance count for the cpu based instances , if you don’t mind could you elaborate what would be the case for gpu based

ログインしていません。 ログイン 回答を投稿する。

優れた回答とは、質問に明確に答え、建設的なフィードバックを提供し、質問者の専門分野におけるスキルの向上を促すものです。

質問に答えるためのガイドライン

関連するコンテンツ