Glue job throwing error : AnalysisException: The namespace in session catalog must have exactly one name part

0

I have creating glue job that is reading parquet file from s3 and using iceberg connector to create iceberg table . I have used catalog name as my_catalog , database I have created with name db and table name I have given is sampletable , though when I run the job it fails with below error: AnalysisException: The namespace in session catalog must have exactly one name part: my_catalog.db.sampletable

質問済み 1年前3642ビュー
1回答
0

Hello,

Make sure to use the catalog name "my_catalog" on your Spark Configuration? Also, verify you're including the spark.sql.extensions (with a value of org.apache.iceberg.spark.extensions.IcebergSparkSessionExtensions) on your Configuration, you can find an example on https://aws.amazon.com/es/blogs/big-data/automate-replication-of-relational-sources-into-a-transactional-data-lake-with-apache-iceberg-and-aws-glue

profile pictureAWS
回答済み 1年前

ログインしていません。 ログイン 回答を投稿する。

優れた回答とは、質問に明確に答え、建設的なフィードバックを提供し、質問者の専門分野におけるスキルの向上を促すものです。

質問に答えるためのガイドライン

関連するコンテンツ