Articles in Analytics

I want to view the Spark UI for my AWS Glue job runs, but I cannot use Docker on my local machine. I need an alternative way to run the Apache Spark History Server natively on macOS to read Spark even...

This article provides general guidance on migrating Database resources from one region to another.

This article demonstrates how to implement comprehensive audit logging for Amazon Athena queries with enriched user identity information. This solution helps organizations in regulated industries meet...

OpenSearch for Agentic Search - The next few series of posts with focus on Agentic Search and various use cases that you can build using Amazon OpenSearch Service. Today we will implement Flow Agents ...

AWS Extended Support charges escalate significantly over time—Year 2 doubles the rate, Year 3+ triples it. For organizations with hundreds of resources, these costs can reach tens of thousands monthly...

I'm running `TRUNCATE` commands in my AWS Glue jobs on iceberg tables managed by AWS Lake Formation with hybrid access mode enabled, but I receive "not authorized to perform: s3:DeleteObject" errors. ...

Stores data in permanent history tables with timestamps

COPY, Spectrum, and Data API

This article provides a ready-to-use Athena SQL query to identify all Amazon ElastiCache clusters running Redis or Valkey engines across AWS accounts using Cost and Usage Report data. Useful for cost ...

Production streaming applications across Apache Flink, Spark Streaming, Kafka Streams, Kinesis Client Library and AWS Lambda might experience throttling on AWS Glue Schema Registry's GetSchemaVersion ...

Apache Iceberg is a leading open table format for analytics. When paired with Kafka Connect, teams can build streaming pipelines into Iceberg tables. However, a known issue with the Kafka Connect Ice...

This article is for architects and database leaders looking to modernize legacy SQL Server–backed Windows apps with minimal risk. It highlights common modernization challenges and shows how AWS Transf...