1 réponse
- Le plus récent
- Le plus de votes
- La plupart des commentaires
0
The exclude pattern could be of special help here:
try using the version*/_temporary**
as the exclude pattern.
This would exclude all the unwanted files other than the parquet files.
For the include pattern, use s3://a/b/c/products/'
you would not need to provide a level for this case.
Check "Create single schema for each S3 path"
This would create one table with "version*" as partitions.
Reference: https://docs.aws.amazon.com/glue/latest/dg/crawler-s3-folder-table-partition.html
répondu il y a 2 ans
Contenus pertinents
- demandé il y a un an
- demandé il y a 3 mois
- demandé il y a un an
- demandé il y a 6 mois
- AWS OFFICIELA mis à jour il y a 2 ans