How to customize crawlers to record Glue Job Target metadata

0

I am looking to have metadata produced by crawlers during Glue Jobs record both source AND target information on the same data catalog table. From the research I have done, recording source metadata is native functionality, while configuring the crawler to record target information requires customization. What are the recommended steps to complete this customization?

1回答
0

Hiya, i think these recommendations can help you, Create a new crawler in the AWS Glue console.

In the "Crawler properties" section, select the "Target" tab. In the "Target table" field, enter the name of the data catalogue table where you want to store the target metadata. In the "Target database" field, enter the name of the database where the data catalogue table resides. In the "Target table properties" section, select the "Include target information" checkbox. In the "Target schema" section, select the schema that you want to use for the target metadata. Click the "Save" button.

this should work

profile picture
回答済み 10ヶ月前

ログインしていません。 ログイン 回答を投稿する。

優れた回答とは、質問に明確に答え、建設的なフィードバックを提供し、質問者の専門分野におけるスキルの向上を促すものです。

質問に答えるためのガイドライン

関連するコンテンツ