使用 AWS re:Post 即表示您同意 AWS re:Post 使用條款
AWS re:Postre:Post

Athena time travel queries with Apache Hudi tables

0

Hi,

Is there a way to perform time travel with Athena queries on Apache Hudi tables in a way similar to the one described here Implement a cdc based upsert in a data lake using Apache Iceberg and AWS Glue?
Or the only way is through spark.sql library at the moment?
Thanks

主題
分析儲存空間
標籤
Amazon Athena分析AWS Glue資料湖
語言
English
AWS-learner
已提問 1 年前檢視次數 804 次
2 個答案
1
已接受的答案

Hello,

I understand that you would want to know if Athena supports time travel queries with Hudi tables. Unfortunately Athena does not currently support time travel queries for Hudi. There is an existing feature request for the same. We may not be able to provide an ETA on when this will be available. I would suggest to keep an eye on our News page/blog for future announcements. https://aws.amazon.com/new/ https://aws.amazon.com/blogs/aws/

Thank you.

AWS
支援工程師
Santosh_S_S
已回答 1 年前
AWS
專家
Fabrizio@AWS
已審閱 9 個月前
0

Are you referring to the MERGE INTO statement that is mentioned in the link? If I understood, your question is - Could the steps mentioned in the Glue job be performed in Athena? Answer is that they cannot be performed directly in Athena as they need a connector, Specific Spark configurations to be set before the spark.sql execution of the MERGE INTO statement.

profile pictureAWS
Ananth Tirumanur
已回答 1 年前
  • AWS-learner
    1 年前

    Hi @ananthtm,

    Thanks for your answer.

    I think I am asking something slightly different. I am not asking if the steps mentioned in the Glue job can be performed in Athena, I am asking if it is possible to write the Hudi version of the following Athena query (which is allowed on Iceberg tables)?

    SELECT * FROM iceberg_table FOR SYSTEM_TIME AS OF TIMESTAMP '2022-11-29 18:14:00'

    Thanks!

您尚未登入。 登入 去張貼答案。

一個好的回答可以清楚地回答問題並提供建設性的意見回饋，同時有助於提問者的專業成長。

回答問題指南

相關內容