Analytics
Recent questions
see all- **Symptoms** - Invocations dropped from steady traffic to zero, with 0 errors and 0 throttles. Records kept arriving on the streams. - The mappings kept reporting `State: Enabled` and `LastProcessingR...
- ## Amazon Redshift password user keeps getting locked, even after I reset it **Error** ``` FATAL: Account locked due to multiple failed login attempts. [SQL State 28000] ``` I unlock the user, but ...
- I am trying to delete a provisioned Amazon Redshift cluster that is integrated with the AWS Glue Data Catalog (lakehouse / unified governance). The deletion is blocked with: > The cluster has an asso...
- Summary Quick Chat Agents can query Datasets, Topics, Dashboards, and Spaces — but they cannot read data from Quick App Storage tables. This means any Quick App that uses App Storage as its data pers...
- Hi, we use Amazon MSK multi-VPC private connectivity with IAM authentication. The MSK cluster is in account A. The client in account B (a different AWS Organization) creates a managed VPC connection ...
- ## Environment - AWS Glue 4.0 (Spark 3.3, Python 3), G.1X workers - Transform: `EntityDetector().detect(...)` from `awsglueml.transforms`, with `detection_parameters` for the built-in entity types and...
- ### Description With the release of AWS Glue 5.0, it is mentioned in the migration guide that **machine learning transforms are no longer supported**. This appears to include the `awsglueml.transfor...
- We are trying out the new direct querying of Apache Iceberg data from Aurora PostgreSQL (`aurora_analytics` extension). One read-only query against a foreign table aborted the backend inside `libduckd...
- Setup: I have a multi-tenant ingestion pipeline on AWS: A shared Kinesis Data Stream (a few hundred shards) receives records from all tenants. The partition key is tenantId:entityId, so all records...
- ## Service Amazon Quick / Amazon QuickSight — Topics (new multi-dataset semantic model), Analysis Q&A ## Severity General guidance / possible defect — blocking our ability to use a new multi-dataset ...
- We are running production OpenSearch Service domains and recently encountered an issue where our .opendistro_security index became degraded / locked us out. According to the official AWS documentatio...
- **Context**: I am trying to query an Amazon S3 Table (managed Iceberg tables feature) using Amazon Athena in the us-east-1 region. The S3 Table resides in a table bucket named **my-s3-table-bucket-tes...
- Account ID: 049xx6562xx Region: ap-south-2 (Hyderabad) Service: AWS Glue I am receiving the following error when attempting to create a Glue Crawler as the root user: "Account 049xx6562xx is denied a...
- I am using an AWS Free Tier account for an academic Data Engineering project. I am trying to use AWS Glue Crawler. I have created the required IAM role and the IAM role validation is successful. How...
- Hello, I am unable to create any MSK Connect connector in account 475820189572 (region us-east-2). The API consistently fails after parameter validation, and the console masks the real error as a per...
- Hi all — I'm trying to open the analytics / user engagement metrics dashboard in Amazon Quick (QuickSight) and the Analytics → View user engagement metrics link stays unclickable. Hoping someone can t...
- Hi team, I see that Amazon Aurora PostgreSQL 18.3+ already natively supports zero-ETL pipelines to Amazon Redshift. However, our current architecture relies on standard Amazon RDS, and we are planning...
- Hi AWS Team, We are currently testing Amazon MSK with an S3 Sink Connector. The MSK cluster, EC2 instance, custom connector plugin, and required IAM roles have been configured. However, we are unabl...
Recent Knowledge Center content
see allRecent articles
see allHyangmok BaekSUPPORT ENGINEER
published 3 days ago0 votes20 views
Teams with strict latency targets sometimes set retries=0 and shorten every producer timeout. On Amazon MSK this turns routine broker restarts, such as rolling patching, into failed sends. With defaul...Hyangmok BaekSUPPORT ENGINEER
published 3 days ago0 votes15 views
This producer error means send() did not get topic metadata within max.block.ms, not that the topic is missing. Beyond missing DESCRIBE permission (covered in another re:Post article), it often hits t...Hyangmok BaekSUPPORT ENGINEER
published 3 days ago0 votes13 views
An MSK Connect connector's target cluster is fixed at creation, so teams often put a DNS alias in bootstrapServers and repoint it to a new cluster. Data can then flow from the new cluster while the co...Hyangmok BaekSUPPORT ENGINEER
published 3 days ago0 votes15 views
EstimatedMaxTimeLag is documented as a time estimate to drain MaxOffsetLag, so it is derived from offset lag rather than measured on its own. As a result, a stalled consumer group on a low-throughput ...- AWS OFFICIALUpdated 2 days ago0 votes159 viewsA practical guide to adopting agentic operations: the concerns teams raise before they start, the AWS services worth evaluating before you build anything yourself, and a roadmap that runs from leaders...
AmritaAWSEXPERT
published 10 days ago0 votes72 views
Amazon Redshift secure logging redacts sensitive values in system table records when a query accesses data protected by federated permissions with fine-grained access control (FGAC). Redaction protect...Jude FolengEXPERT
published 12 days ago1 votes115 views
An Amazon Redshift cluster can accumulate **idle sessions** — connections that remain open but are no longer actively used by a client (for example, the application crashed, a network link dropped sil...Jueli Ulhas PaygudeEXPERT
published 17 days ago0 votes85 views
Amazon Redshift publishes rich CPU, disk, and query-latency metrics to CloudWatch out of the box, and you can extend that same monitoring to two signals that often explain how many transactions are cu...Jeongho KimSUPPORT ENGINEER
published 18 days ago0 votes82 views
When your security policy prevents security group references and you allow each Amazon MSK broker private IP individually in security groups or firewalls, it is hard to tell which IPs stay and which c...Tolu Okuboyejo - AWSEXPERT
published 19 days ago0 votes91 views
When an Amazon Redshift cluster slows down, CloudWatch shows the symptom—high CPU and commit-queue pressure—but not which queries caused it or how to fix them. Answering that traditionally required a ...Rakesh ReddyEXPERT
published 22 days ago1 votes212 views
Zero-ETL integrations replicate data from many sources (like Aurora PostgreSQL/Mysql) into Amazon Redshift in near real time, without you building/managing complex ETL pipelines. Once it is setup, you...- AWS OFFICIALUpdated 22 days ago0 votes123 viewsLearn how to pair Amazon Redshift's long-term system table retention in Amazon Simple Storage Service (Amazon S3) Tables with the Amazon Redshift Model Context Protocol (MCP) server. Use this combinat...
Atmankumar VaghamshiEXPERT
published 23 days ago0 votes97 views
Multi-tenant SaaS providers running all workloads under a single AWS Organization with one Organizational Unit (OU) per tenant hit a common wall: CUR 2.0 has no native OU column, so tenant-level cost ...John AgustinEXPERT
published 23 days ago2 votes128 views
By default, the Cost and Usage Report (CUR) does not include AWS Organizations details. A work around this limitation is by pulling the AWS Organizations data and joining it with CUR in Athena or in A...Jeongho KimSUPPORT ENGINEER
published a month ago0 votes51 views
The first Data API statement sent to an idle Amazon Redshift Serverless workgroup can fail with an internal error, while resending the same SQL as a new statement succeeds. This article explains how t...Hyangmok BaekSUPPORT ENGINEER
published a month ago0 votes102 views
n MSK Connect restart preserves all configuration and committed offsets, runs asynchronously, and requires the connector to be RUNNING with no other lifecycle operation in progress. This article cover...Hyangmok BaekSUPPORT ENGINEER
published a month ago0 votes75 views
On Amazon MSK, a Kafka Streams application can rebalance at a regular interval even though no instance joined or left. These are usually probing rebalances. This article covers where to get the client...Hyangmok BaekSUPPORT ENGINEER
published a month ago0 votes103 views
With processing.guarantee=exactly_once_v2, Kafka Streams overrides the producer transaction.timeout.ms to 10,000 ms (not the documented 60,000 ms) and commit.interval.ms to 100 ms. This article shows ...
Recent selections
see allAWS OfficialEXPERT
published a year ago0 votes409 views
This spotlight on Amazon OpenSearch Service equips you with the skills and troubleshooting tips to get the most out of a powerful service.AWS OfficialEXPERT
published a year ago0 votes433 views
This spotlight on Amazon Redshift equips you with the skills and troubleshooting tips to get the most out of a powerful service.AWS OfficialEXPERT
published 2 years ago0 votes497 views
This spotlight on AWS Glue equips you with the skills and troubleshooting tips to get the most out of a data integration service.Henry Fuentes JrEXPERT
published 2 years ago0 votes775 views
This spotlight on Amazon EMR equips you with the skills and troubleshooting tips to get the most out of a cloud big data platform service.Giovanni LauriaEXPERT
published 3 years ago1 votes22.8K views
Harnessing Real-Time Streaming for Scalable Data Processing and Analysis- AWS OFFICIALUpdated 3 years ago0 votes531 viewsThe Cloud Intelligence Dashboards are a series of QuickSight templated dashboards built on AWS native services supported by a dedicated framework for managing access to the data. These dashboards incl...
- AWS OFFICIALUpdated 3 years ago0 votes103 viewsCloud Financial Management (CFM) is a discipline that combines tools, processes, and practices to plan, manage, and optimize cloud costs while letting enterprises innovate and scale to take advantage ...
- AWS OFFICIALUpdated 3 years ago0 votes94 viewsGame developers are embracing industry-wide transformation, with studios pushing the latest technology boundaries and delivering continuously updated gaming experiences that scale to tens of millions ...
secondabhi_aws
EXPERTUri Segev
EXPERTGiovanni Lauria
EXPERTOsvaldo Marte
EXPERTAdeleke Adebowale .J.
EXPERTGonzalo Herreros
EXPERTLeeroy Hannigan
EXPERTAWS-User-alantam
EXPERTIndranil Banerjee AWS
EXPERTTakahito Iwasa
EXPERTMassimilianoAWS
EXPERTFabrizio
EXPERTGunasekaran, Makendran
EXPERTThanniru Anil Kumar
EXPERTkranthi putti
EXPERT
