Hi all,
I run a simple query on Athena using Athena engine version 3.
create table if not exists "test"."total_customer" as
select *
from "A_customer"
union all
select *
from "B_customer"
And I faced this error:
HIVE_PATH_ALREADY_EXISTS: Target directory for table 'test.total_customer' already exists: s3://xxxx/total_customer/2022/11/27/tables/ef02d72d-75e2-4b14-b53f-95d591094cfa. You may need to manually clean the data at location 's3://xxxx/total_customer/2022/11/27/tables/ef02d72d-75e2-4b14-b53f-95d591094cfa' before retrying. Athena will not delete data in your account.
The weird thing is it works perfectly when I use UNION instead of UNION ALL. So I'm not sure if this is Athena engine version 3 error or the query error.
Thank you guys for taking a look at my issue.
Thank Theo for supporting. Waiting for your reply.