Savings Plans Applicability to ML instances

0

ML instances are not specifically listed under the available instance types for Savings Plans: https://aws.amazon.com/savingsplans/pricing/ But there is nothing that explicitly excludes them.

Are ML instances (https://aws.amazon.com/sagemaker/pricing/instance-types/) covered under the compute or instance savings plans?

AWS
質問済み 4年前405ビュー
2回答
0
承認された回答

Savings plans only apply to EC2 (compute and EC2 instance savings plans) and Fargate instances (compute savings plans). They do not apply to other services, such as SageMaker.

For cost optimization, SageMaker supports spot instances for training jobs, and for the hosting of real-time inference endpoints, look at:

  • right-sizing and auto-scaling the endpoint
  • Using elastic inference or inf1 instances (support for inf1 in SageMaker is on the roadmap)
  • Compiling models with Neo to optimize model performance (for rightsizing)
  • Using inference pipelines instead of multiple model endpoints
  • Hosting in multi-model endpoints
  • Hosting in self-managed compute, such as EC2 with RI, Lambda, or Fargate/spot.

Elastic inference, Neo, inference pipelines and multi-model endpoints work well in some, but not all use-cases, depending on use case, model framework, complexity, size, etc. so it will require some investigation and experimentation to figure out of they’re right for you, but they can help reduce inference cost significantly.

回答済み 4年前
0

Since the accepted answer was posted 2 years ago, we've actually launched Savings Plans for SageMaker already, so for more information check out this page: https://aws.amazon.com/savingsplans/ml-pricing/

profile pictureAWS
エキスパート
回答済み 2年前
profile picture
エキスパート
レビュー済み 2ヶ月前

ログインしていません。 ログイン 回答を投稿する。

優れた回答とは、質問に明確に答え、建設的なフィードバックを提供し、質問者の専門分野におけるスキルの向上を促すものです。

質問に答えるためのガイドライン

関連するコンテンツ