AWS Glue create_dynamic_frame.from_catalog Failed to find data source: UNKNOWN

0

Here is my code snippet:

[transaction_DyF = glueContext.create_dynamic_frame.from_catalog( database = source_db, table_name = source_tbl, push_down_predicate = pushDownPredicate, transformation_ctx = source_tbl)

Error Message:

Error: An error occurred while calling o103.getDynamicFrame.\n: java.lang.ClassNotFoundException: Failed to find data source: UNKNOWN

  • Hello - can you please explain from where you trying to read? You can also try from_options if you are trying to read from s3, rds and other sources.

mrjimi
質問済み 1年前341ビュー
1回答
0

Calling the create_dynamic_frame.from_catalog is supposed to return a dynamic frame that is created using a Data Catalog database and table provided. However, in this case it is likely that the table input classification is UNKNOWN, when the crawler detects no pattern in files to classify it, a table with a classification UNKNOWN is created.

Check the table properties in Data Catalog for classification. See below link on creating a custom classifier.

AWS
John_M
回答済み 1年前

ログインしていません。 ログイン 回答を投稿する。

優れた回答とは、質問に明確に答え、建設的なフィードバックを提供し、質問者の専門分野におけるスキルの向上を促すものです。

質問に答えるためのガイドライン

関連するコンテンツ