We have a large parquet file which is stored in S3 storage. It contains the data for 6 months of logs or even more. As as service we need to run a query to fetch the user data from parquet file. It has to be done end-to-end using aws data apis.
I have explored the redshift but the challenge is data loading from s3 to redshift needs additional effort such as provisioning a cluster and copying data from S3 to redshift data base.
I have the following query.
Redshift provisioning can be done using aws data APIs ?
How to run the query to fetch user data from redshift database. Is any data apis available for this?
Is there any better aws service is available other than redshift ?