Glue job throwing error : AnalysisException: The namespace in session catalog must have exactly one name part

Question

I have creating glue job that is reading parquet file from s3 and using iceberg connector to create iceberg table . I have used catalog name as my_catalog , database I have created with name db and table name I have given is sampletable , though when I run the job it fails with below error:
**AnalysisException: The namespace in session catalog must have exactly one name part: my_catalog.db.sampletable**

Answer

Hello,

Make sure to use the catalog name "my_catalog" on your Spark Configuration? Also, verify you're including the spark.sql.extensions (with a value of org.apache.iceberg.spark.extensions.IcebergSparkSessionExtensions) on your Configuration, you can find an example on https://aws.amazon.com/es/blogs/big-data/automate-replication-of-relational-sources-into-a-transactional-data-lake-with-apache-iceberg-and-aws-glue

Glue job throwing error : AnalysisException: The namespace in session catalog must have exactly one name part

Relevanter Inhalt