Amazon Quicksight SPICE Data set partition

0

I have been searching for a documentation on how SPICE partitions data set but found none. How does the SPICE engine partition data set from S3 via a Manifest File?

AWS
Bims_D
已提問 5 年前檢視次數 1110 次
1 個回答
0
已接受的答案

SPICE does not partition the data. It simply loads the data from all the files listed in the manifest into a single table. This is why there is a requirement that the data types for every field have to be the same in all files listed in the manifest.

You can read more about this here https://docs.aws.amazon.com/quicksight/latest/user/data-sets-based-on-multiple-s3-files.html

If you want to leverage partitions on S3, you can use Athena to query the data set on S3 before it gets imported into SPICE. Using Athena with QuickSight allows you to load a complete table from Athena or write a custom SQL query to load. With a custom SQL query, you can leverage your Athena partitions at query time, prior to having the result set loaded into SPICE.

https://docs.aws.amazon.com/quicksight/latest/user/create-a-data-set-athena.html

已回答 5 年前

您尚未登入。 登入 去張貼答案。

一個好的回答可以清楚地回答問題並提供建設性的意見回饋,同時有助於提問者的專業成長。

回答問題指南