crawler can not find the table

0

Hi. I had a table that was created by a crawler, then I deleted the table ( in Athena) and created it by DDL. after running crawler. it could not find the table and create a new table. note: The s3 objects were as they were before.. any one has any opinion?

profile picture
gh02
asked 2 months ago363 views
1 Answer
0

Hi,

When you re-created the table using the DDL statement, the metadata (such as the database name, table name, column names, and data types) might not have matched the metadata that the crawler was expecting. AWS Glue crawlers rely on the metadata stored in the AWS Glue Data Catalog to identify existing tables. Or if the re-created table was not registered with the AWS Glue Data Catalog, the crawler would not be able to find it. AWS Glue crawlers only scan tables that are registered in the Data Catalog.

Refer - https://docs.aws.amazon.com/glue/latest/dg/populate-catalog-methods.html for guidance around Data Catalog settings.

AWS
answered 2 months ago
profile picture
EXPERT
reviewed 2 months ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions