When will Redshift be compatible with Apache Iceberg format?

3

Apache Iceberg is a table format designed for use in large-scale data processing systems like Apache Spark, Presto, and AWS Athena. It is designed to provide ACID transactions, scalable data management, and efficient data access.

As a user, it is conceptually much simple to maintain because metadata is managed by Itself. So no more manual ADD PARTITION or DELETE PARTITION.

Knowing that Iceberg is already compatible with many services of AWS (Athena, Glue, Presto using EMR), when will Redshift be compatible with Apache Iceberg format?

asked a year ago1904 views
5 Answers
2

At this time, there is no official announcement from AWS or the Amazon Redshift team regarding compatibility with the Apache Iceberg format. However, AWS is constantly updating its services to add new features and improve compatibility with other tools and technologies, so it is possible that Redshift may support Iceberg in the future. It's always a good idea to keep an eye on the official AWS documentation and announcements for updates on this topic.

AWS
answered a year ago
AWS
EXPERT
reviewed 10 months ago
1
  • Big thanks to Amazon Web Services (AWS) for actively listening to our feedback!

1

This is also a feature which is make or break for our solution to use redshift, would be amazing if iceberg support is in the near future

answered a year ago
1

Will add a +1 to this. We're ingesting data into our data lake using Fivetran. It satisfies our external vendor's use case, because that's how they consume our data, but our internal data analysts are forced to use Athena to query data. This isn't ideal, because all of our other data is in Redshift, so they are having to manually export the iceberg data.

answered a year ago
1

Plus 1 again. All of the other major warehouse solutions (BigQuery, Snowflake namely) already support Iceberg tables. Redshift needs to accelerate their product offering to remain competitive

Todd
answered 10 months ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions