Cost Explorer not matching CLI

Question

I've written a small python program to extract glue run jobs.  I'm extracting the run duration and using the following calculation to determine the cost. effective_duration = max(run_duration / 3600, 1 / 60). For the month of November I caculate the DPU run as 7.4 hours, where cost explorer calculates at 35.871 DPU-Hour. Even if I round each of the ExecutionTime to the closest minuite, it still doens't match. I'm searching between 2 dates in CLI. How can I get this to closely match?

Answer

Hi Mark,

have you taken into account that there are minimum requirements for DPUs depending on the type of job. From https://aws.amazon.com/glue/pricing/

> There are four types of AWS Glue jobs: Apache Spark, Apache Spark Streaming, Ray (Preview), and Python Shell. Spark and Spark Streaming job runs **require a minimum of 2 DPUs**. By default, AWS Glue allocates 10 DPUs to each Spark job and 2 DPUs to each Spark Streaming job. Jobs using AWS Glue version 0.9 or 1.0 have a **10-minute minimum billing duration**, while jobs that use AWS Glue versions 2.0 and later have a 1-minute minimum.

And please note that you can always create a Billing support case, regardless of Support Plan: https://docs.aws.amazon.com/awsaccountbilling/latest/aboutv2/billing-get-answers.html

Cost Explorer not matching CLI

Relevant content