By using AWS re:Post, you agree to the AWS re:Post Terms of Use
AWS re:Postre:Post

AWS Glue Crawler: Got an error Internal Service Exception

0

Hi, I have used Firehose, AWS Glue Crawler, and Athena since 2022, and everything as well until May 2023, when the AWS Glue Crawler got an Internal Service Exception. I can't find the exact reason. I also checked the Data Catalog -> Databases -> Schema and realized it created a partition hour only instead of partitions year, month, and day.

Can you guys help me predict my trouble? Thank you in advance.

Enter image description here

Topics
Analytics
Tags
Amazon AthenaAWS Glue
Language
English
Tham
asked 8 months ago1411 views
1 Answer
3

You get Internal Service Exception on AWS Glue Crawler due to various reasons such as inconsistent data structure from upstreams, or if your data catalog has larger number of columns or nested structure that might exceeded the schema size limit. You can first check your crawler logs to see the possible errors. You can also refer https://repost.aws/knowledge-center/glue-crawler-internal-service-exception for further possible conditions that might triggered the exception. If the mentioned reasons don't apply to you it is better to open support case.

profile pictureAWS
BezuW
answered 8 months ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions

Relevant content