Managed Apache Flink - KPUs too high and not related to CPU usage

0

According to AWS docs:

*You are charged an hourly rate based on the number of Kinesis Processing Units (KPUs) used to run your applications. A single KPU comprises 1 vCPU compute and 4 GB of memory. *

I have several Flink jobs running in Managed Apache Flink on AWS. They have auto scaling enabled. All jobs run the same code. The problem is there seems to be no correlation between the CPU usage and the KPUs that AWS decides to provide my jobs. According to aws docs: your application will scale up when containerCPUUtilization is larger than 75 percent or above for 15 minutes.

For one of the jobs the "container cpu utilization" recently dropped from around ~25% to ~15% when the "kpu" metric shot up from 27 to 51 units. How can I lower my KPUs for these jobs? I do not believe they really require this amount of processing power. Below is a photo showing two jobs that run the same code however have wildly different cpu usage, and the same kpus.

Enter image description here

Enter image description here

Louis
已提问 1 个月前532 查看次数
没有答案

您未登录。 登录 发布回答。

一个好的回答可以清楚地解答问题和提供建设性反馈,并能促进提问者的职业发展。

回答问题的准则

相关内容