AWS Glue create_dynamic_frame.from_catalog Failed to find data source: UNKNOWN

0

Here is my code snippet:

[transaction_DyF = glueContext.create_dynamic_frame.from_catalog( database = source_db, table_name = source_tbl, push_down_predicate = pushDownPredicate, transformation_ctx = source_tbl)

Error Message:

Error: An error occurred while calling o103.getDynamicFrame.\n: java.lang.ClassNotFoundException: Failed to find data source: UNKNOWN

  • Hello - can you please explain from where you trying to read? You can also try from_options if you are trying to read from s3, rds and other sources.

mrjimi
已提问 1 年前341 查看次数
1 回答
0

Calling the create_dynamic_frame.from_catalog is supposed to return a dynamic frame that is created using a Data Catalog database and table provided. However, in this case it is likely that the table input classification is UNKNOWN, when the crawler detects no pattern in files to classify it, a table with a classification UNKNOWN is created.

Check the table properties in Data Catalog for classification. See below link on creating a custom classifier.

AWS
John_M
已回答 1 年前

您未登录。 登录 发布回答。

一个好的回答可以清楚地解答问题和提供建设性反馈,并能促进提问者的职业发展。

回答问题的准则