1 Answer
- Newest
- Most votes
- Most comments
0
【以下的回答经过翻译处理】 我已经弄清楚了这个问题。我错过了一个步骤,需要将additionalOptions添加到我的sink中,如下所述: https://medium.com/analytics-vidhya/add-new-partitions-in-aws-glue-data-catalog-from-aws-glue-job-79b0442b17af
#参数“enableUpdateCatalog”告诉aws glue工作更新glue数据目录,因为创建新分区
additionalOptions = {"enableUpdateCatalog": True}
#定义分区键
additionalOptions["partitionKeys"] = ["year", "month","day"]
做了这个之后,分区(嵌套目录)被创建。
Relevant content
- Accepted Answerasked 2 months ago
- asked a year ago
- AWS OFFICIALUpdated 5 months ago
- AWS OFFICIALUpdated a year ago
- AWS OFFICIALUpdated a year ago
- AWS OFFICIALUpdated 2 years ago