Resource utilization exceed the limit as per billing in serverless

0

I run one application without pre-initialized capability in Emr serverless and thr explicit limit set to 40vCPUs, 300gb memory, 2000gb disk. After the every job execution, resources utilization and billing shows exceeded vCPUs limit for an instance sometimes shows 64.55 vCPU. May I know why this discrepancy and could someone please clear if you have experienced this before?

Thanks in advance

Vaas
已提问 6 个月前286 查看次数
1 回答
3
已接受的回答

Hello,

Basically, application levels limits are different from total Resource utilization in a job that showed in the console. Application limits helps control the total number of cores you can provision across multiple jobs running in an application concurrently whereas resource utilization is the total resources utilized in hours for billing calculation.

For an instance,Lets say, suppose I have 1 driver and 1 executor with 4vCPUs each, application limit with 10vCPUs and my job runs for 5hours, then the total resource vCPUs utilization will be approx. 80vCPUs hours. (4vCPUs driver + 4vCPUs executor = 8 * 5 hours = 40vCPUs).

AWS
支持工程师
已回答 6 个月前
profile picture
专家
已审核 5 个月前
profile picture
专家
已审核 6 个月前
  • It makes sense. Thanks for the clarification 👍

您未登录。 登录 发布回答。

一个好的回答可以清楚地解答问题和提供建设性反馈,并能促进提问者的职业发展。

回答问题的准则