Amazon Web Services announces a new integrated analytics experience and zero-ETL integration between Amazon CloudWatch and Amazon OpenSearch Service for customers to get the best of both services.
A new zero-ETL integration between Amazon CloudWatch and Amazon OpenSearch Service that provides a seamless analytics experience, is now generally available. This integration enables CloudWatch users to leverage OpenSearch Service’s powerful query capabilities and visualization tools directly on their log data, without the need for complex data movement or duplication.
Key features of this integration include:
- Advanced query languages: CloudWatch users can now utilize OpenSearch Service’s Piped Processing Language (PPL) and SQL directly within the CloudWatch Logs Insights console. This allows for more complex operations such as joining data across log groups and using advanced functions for deeper log analysis.
- Out-of-the-box dashboards: Pre-built, curated dashboards are now available, including Amazon VPC Flow Logs, AWS CloudTrail, and AWS WAF. These dashboards, powered by OpenSearch Service materialized views, enable faster monitoring and troubleshooting of critical infrastructure and security logs.
- Zero-ETL Analytics for OpenSearch Service Users: OpenSearch Service customers can now analyze CloudWatch Logs data without the need for data duplication or maintaining separate ETL pipelines. This allows for seamless integration of CloudWatch data into existing OpenSearch Service analytics workflows.
- Flexibility and performance improvement: Customers have the option to create custom indexes and materialized views, enabling faster query performance for frequently accessed data while maintaining cost-effectiveness for less frequently queried information.
This integration will help you reduce operational overhead, improve log investigation efficiency, and gain deeper insights from your operational data by eliminating the need for complex data pipelines and enabling advanced analytics directly on CloudWatch data. Read our launch blog to learn more and visit the OpenSearch Service and CloudWatch product pages for more information. Please also visit the CloudWatch pricing and OpenSearch Service pricing pages for pricing details and to explore the free tier options.