How to Disable Periodic Monitoring Queries in AWS Redshift Serverless zero-etl Integrated with Aurora

0

Hello,

I have an AWS Aurora database instance integrated with AWS Redshift Serverless using the Zero-ETL integration. To optimize for cost efficiency, I've configured Redshift Serverless with the lowest possible base computing capacity. However, I've noticed that every 5 minutes, the Redshift Serverless cluster starts up and executes the following queries:

SELECT pg_last_query_id();
SELECT * FROM pg_catalog.SVV_INTEGRATION WHERE integration_id='<uuid>';
SET application_name = 'Amazon Redshift Data API - RedshiftConsole - <uuid> - DataAPISingle';

From my analysis, these appear to be monitoring-related queries, likely initiated by AWS.

My questions are:

  1. Are these queries indeed for AWS's internal monitoring purposes?
  2. Is there any way to disable or reduce the frequency of these periodic checks to avoid unnecessary cluster activation and reduce costs?
  3. If these queries are executed because of the Zero-ETL integration, is it possible to pause the integration periodically to prevent the cluster from starting up unnecessarily?

Thank you!

1 Answer
1

Hello Od,

Thank you very much for your question. Regarding your questions, please find the answer below:

  1. Are these queries for AWS's internal monitoring purposes? Yes, the queries are most likely executed by AWS for monitoring and management purposes. The pg_last_query_id() function retrieves the last query ID executed on the cluster, while the SVV_INTEGRATION view provides information about the Zero-ETL integration between Aurora and Redshift Serverless.
  2. Is there any way to disable or reduce the frequency of these periodic checks? Unfortunately, there is no direct way for customers to disable or reduce the frequency of these internal monitoring queries. AWS manages the Redshift Serverless cluster and performs these checks to ensure the proper functioning and availability of the service.
  3. Is it possible to pause the Zero-ETL integration periodically? Currently, there is no option to pause the Zero-ETL integration between Aurora and Redshift Serverless. The integration is designed to provide a seamless and continuous data transfer between the two services. You could provide feedback to AWS regarding the cost impact of these monitoring queries and request the ability to control or reduce their frequency. AWS may consider implementing such a feature in the future if there is sufficient customer demand.

It's important to note that while these monitoring queries may incur some additional costs due to cluster activation, they are essential for AWS to ensure the proper functioning and availability of the Redshift Serverless service. AWS likely balances the frequency of these checks to minimize the cost impact while still maintaining the necessary level of monitoring and management. Hope it helps!

AWS
answered a month ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions