- Newest
- Most votes
- Most comments
Understanding the Charges
AWS Glue Interactive Sessions charges you based on the time the session is active and the number of Data Processing Units (DPUs) you provision. The billing starts when you start an interactive session and continues until you stop it.
- Session Start: The billing begins when you start the Spark session using the interactive session.
- Active Time: You are charged for the time the session is active, including idle time, until the session is stopped.
- Minimum Billing Duration: There is a minimum billing duration of 1 minute for each provisioned interactive session.
- Idle Timeout: Configurable idle timeout helps in automatically stopping the session if it remains idle for a specified period, reducing unnecessary charges.
Stopping the Spark Session
Using %stop_session to stop the Spark session in the AWS Glue Interactive Session Notebook will stop the session and thereby stop further charges from accruing for that session. However, if the notebook itself remains active and other sessions are started, those will be billed accordingly.
%stop_session
After executing %stop_session
, the active session stops, and you should not incur additional charges for that session.
Requests in AWS Free Usage Tier
The "requests" mentioned in your free tier bill refer to API requests. In the context of AWS Glue:
- Requests: Typically refer to API calls made to manage or execute Glue jobs, interactive sessions, data catalog requests, etc.
- Not ETL Runs: They do not correspond to every run of your ETL job. Instead, they represent individual API calls made to the AWS Glue service.
Summary
- Charges for Interactive Sessions:
- Start when you initiate the Spark session.
- Continue as long as the session is active.
- Include idle time until the session is explicitly stopped or times out based on the idle timeout configuration.
- Stopping Charges:
- Using %stop_session halts the Spark session and stops further charges.
- Ensure no other active sessions are running to avoid additional charges.
- Free Tier Requests:
- Refer to API calls made to AWS services.
- Do not equate to the execution of the entire ETL job but rather the management and interaction with AWS Glue resources.
By managing your Spark sessions carefully and utilizing idle timeouts effectively, you can optimize your costs while using AWS Glue Interactive Sessions.
Relevant content
- asked a year ago
- asked a year ago
- asked 3 years ago
- asked 3 years ago
- AWS OFFICIALUpdated 6 months ago
- AWS OFFICIALUpdated 3 months ago
- AWS OFFICIALUpdated 3 months ago
- AWS OFFICIALUpdated 3 months ago