Error while running athena query : HIVE_CANNOT_OPEN_SPLIT

0

HIVE_CANNOT_OPEN_SPLIT: Error opening Hive split s3://si-dag-uploads/si-demo/fact_pipeline_workflow_step_instances/dt=2023-08-24/fact_pipeline_workflow_step_instances_0011_part_13.parquet (offset=67108864, length=67108864): com.amazonaws.services.s3.model.AmazonS3Exception: Please reduce your request rate. (Service: Amazon S3; Status Code: 503; Error Code: SlowDown; Request ID: F2D3SC7FWFM0HYD1; S3 Extended Request ID: Vcct1yhjix41QIrLMfpfH34AqG79nOENWCzp9n9hwaZCeTkypr09txYHaPkhFSZ6WN7fkgux/dsAxBb7xrS0fxWE3sbxJPTt+SBnEUyYSnU=; Proxy: null), S3 Extended Request ID: Vcct1yhjix41QIrLMfpfH34AqG79nOENWCzp9n9hwaZCeTkypr09txYHaPkhFSZ6WN7fkgux/dsAxBb7xrS0fxWE3sbxJPTt+SBnEUyYSnU= This query ran against the "si-demo" database, unless qualified by the query. Please post the error message on our forum or contact customer support with Query Id: 4ad35262-b091-418c-ad4b-8769d012a1ca

asked 8 months ago293 views
2 Answers
0

I think it is related to throttling issue.

If your queries exceed the limits of dependent services such as Amazon S3, AWS KMS, AWS Glue, or AWS Lambda, the following messages can be expected. To resolve these issues, reduce the number of concurrent calls that originate from the same account.

https://docs.aws.amazon.com/athena/latest/ug/performance-tuning-s3-throttling.html

AWS
answered 8 months ago
0

AWS sort of had a meltdown (at least in my region) a few days ago, and these kinds of errors were common. Since then, the errors come less frequently, but I'm still seeing them. There are some other queries that used to run reliably that "exhaust resources" every time now. I wonder if Amazon implemented some emergency throttling when the meltdown occurred.

answered 8 months ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions