Resource utilization exceed the limit as per billing in serverless

0

I run one application without pre-initialized capability in Emr serverless and thr explicit limit set to 40vCPUs, 300gb memory, 2000gb disk. After the every job execution, resources utilization and billing shows exceeded vCPUs limit for an instance sometimes shows 64.55 vCPU. May I know why this discrepancy and could someone please clear if you have experienced this before?

Thanks in advance

Vaas
質問済み 6ヶ月前286ビュー
1回答
3
承認された回答

Hello,

Basically, application levels limits are different from total Resource utilization in a job that showed in the console. Application limits helps control the total number of cores you can provision across multiple jobs running in an application concurrently whereas resource utilization is the total resources utilized in hours for billing calculation.

For an instance,Lets say, suppose I have 1 driver and 1 executor with 4vCPUs each, application limit with 10vCPUs and my job runs for 5hours, then the total resource vCPUs utilization will be approx. 80vCPUs hours. (4vCPUs driver + 4vCPUs executor = 8 * 5 hours = 40vCPUs).

AWS
サポートエンジニア
回答済み 6ヶ月前
profile picture
エキスパート
レビュー済み 5ヶ月前
profile picture
エキスパート
レビュー済み 6ヶ月前
  • It makes sense. Thanks for the clarification 👍

ログインしていません。 ログイン 回答を投稿する。

優れた回答とは、質問に明確に答え、建設的なフィードバックを提供し、質問者の専門分野におけるスキルの向上を促すものです。

質問に答えるためのガイドライン

関連するコンテンツ