Glue job throwing error : AnalysisException: The namespace in session catalog must have exactly one name part

I have creating glue job that is reading parquet file from s3 and using iceberg connector to create iceberg table . I have used catalog name as my_catalog , database I have created with name db and table name I have given is sampletable , though when I run the job it fails with below error: AnalysisException: The namespace in session catalog must have exactly one name part: my_catalog.db.sampletable

주제

분석 데이터베이스

태그

AWS Glue 데이터 추출, 변환 및 로드

언어

English

Anurag Mishra

질문됨 일 년 전3642회 조회

1개 답변

최신
최다 투표
가장 많은 댓글

이 답변이 도움이 되었나요?커뮤니티가 여러분의 지식을 활용할 수 있도록 정답을 찬성하세요.

Hello,

Make sure to use the catalog name "my_catalog" on your Spark Configuration? Also, verify you're including the spark.sql.extensions (with a value of org.apache.iceberg.spark.extensions.IcebergSparkSessionExtensions) on your Configuration, you can find an example on https://aws.amazon.com/es/blogs/big-data/automate-replication-of-relational-sources-into-a-transactional-data-lake-with-apache-iceberg-and-aws-glue

Luis Gerardo Baeza

답변함 일 년 전

Glue job throwing error : AnalysisException: The namespace in session catalog must have exactly one name part

관련 콘텐츠