How to customize crawlers to record Glue Job Target metadata

0

I am looking to have metadata produced by crawlers during Glue Jobs record both source AND target information on the same data catalog table. From the research I have done, recording source metadata is native functionality, while configuring the crawler to record target information requires customization. What are the recommended steps to complete this customization?

1개 답변
0

Hiya, i think these recommendations can help you, Create a new crawler in the AWS Glue console.

In the "Crawler properties" section, select the "Target" tab. In the "Target table" field, enter the name of the data catalogue table where you want to store the target metadata. In the "Target database" field, enter the name of the database where the data catalogue table resides. In the "Target table properties" section, select the "Include target information" checkbox. In the "Target schema" section, select the schema that you want to use for the target metadata. Click the "Save" button.

this should work

profile picture
답변함 10달 전

로그인하지 않았습니다. 로그인해야 답변을 게시할 수 있습니다.

좋은 답변은 질문에 명확하게 답하고 건설적인 피드백을 제공하며 질문자의 전문적인 성장을 장려합니다.

질문 답변하기에 대한 가이드라인

관련 콘텐츠