Hi Team, I want to create only 2 crawler tables (Folder_x & Folder_y) for below path irrespective of the schemas 1. S3> Folder_x> Folder_x1>Folder_x2 > file1.txt 2. S3> Folder_x> Folder_x1>Folder_x2 >file2.txt 2. S3> Folder_y> Folder_y1>Folder_y2 > file3.txt 3. S3> Folder_y> Folder_y1>Folder_y2 >files4.txt Could you please help me on this Thank you in advance

You can follow the steps outlined at [Tutorial: Adding an AWS Glue crawler](https://docs.aws.amazon.com/glue/latest/ug/tutorial-add-crawler.html) and choose the S3 path as `S3> Folder_x` for the first one and for the second crawler choose path `S3> Folder_y`. This will allow you to run or re-run each crawler independently as your data changes.

Single CRAWLER Table for S3 Path

Hi Team,

I want to create only 2 crawler tables (Folder_x & Folder_y) for below path irrespective of the schemas

S3> Folder_x> Folder_x1>Folder_x2 > file1.txt
S3> Folder_x> Folder_x1>Folder_x2 >file2.txt
S3> Folder_y> Folder_y1>Folder_y2 > file3.txt
S3> Folder_y> Folder_y1>Folder_y2 >files4.txt

Could you please help me on this

Thank you in advance

주제

분석

태그

AWS Glue

언어

English

Bharath

질문됨 9달 전168회 조회

1개 답변

최신
최다 투표
가장 많은 댓글

이 답변이 도움이 되었나요?커뮤니티가 여러분의 지식을 활용할 수 있도록 정답을 찬성하세요.

You can follow the steps outlined at Tutorial: Adding an AWS Glue crawler and choose the S3 path as S3> Folder_x for the first one and for the second crawler choose path S3> Folder_y.

This will allow you to run or re-run each crawler independently as your data changes.

MilindOke

답변함 9달 전

Single CRAWLER Table for S3 Path

관련 콘텐츠