By using AWS re:Post, you agree to the AWS re:Post Terms of Use

[Athena] Error creating Iceberg table

0

I am trying to create iceberg table with CTAS using CLI but getting internal error. Using athena engine version 3 Here is my query CREATE TABLE test_db_2.test_table_2 WITH (table_type = 'ICEBERG', format = 'PARQUET', location = 's3://bucket_namexxx/test_db_2/test_table_2/', is_external = false ) AS SELECT col1, col2, col3 from test_db_1.test_table_1;

FAILED  [ErrorCode: INTERNAL_ERROR_QUERY_ENGINE] Amazon Athena experienced an internal error while executing this query. Please contact AWS support for further assistance. You will not be charged for this query. We apologize for the inconvenience. You may need to manually clean the data at location 's3://xxxxxx/tables/3xxxxxxxxxxx' before retrying. Athena will not delete data in your account.

Any idea what is the issue? Where can I see the detailed error?

asked a year ago1.4K views
2 Answers
0

Did you try adding From keyword in second part of your query as below:

 CREATE TABLE test_db_2.test_table_2 WITH (table_type = 'ICEBERG', format = 'PARQUET', location = 's3://bucket_namexxx/test_db_2/test_table_2/', is_external = false ) AS SELECT col1, col2, col3 from test_db_1.test_table_1;

Also, did you try running the same query in different engine version.

Most probable cause of this type of error use to be, when we mistakenly use Athena reserved keyword listed here, but it doesn't seem to be the case here.

Comment here how it goes, happy to help.

Abhishek

profile pictureAWS
EXPERT
answered a year ago
  • Hi Abhishek, Yes "from" is there in the query.. it was missed while posting question.. Have updated it.. Also with Athena version 2 it is giving unsupported error as suggesting to use version 3.

  • Can you explain, what is the purpose of this query "AS SELECT col1, col2, col3 from test_db_1.test_table_1"?

    Did you try creating the iceberg table, with this syntax:

    CREATE TABLE iceberg_table ( id int, data string, category string) PARTITIONED BY (category, bucket(16,id)) LOCATION 's3://DOC-EXAMPLE-BUCKET/iceberg-folder' TBLPROPERTIES ( 'table_type'='ICEBERG', 'format'='parquet', 'write_compression'='snappy', 'optimize_rewrite_delete_file_threshold'='10' )

0

Found a typo in the bucket name.. I wish the internal logs are available to us for these kind of error.

answered a year ago
  • I'm glad you found the problem at least :)

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions