- 最新
- 投票最多
- 评论最多
Hi,
building a data lake is a complex topic and there isn't usually a single "best" solution. It depends a lot on your requirements, data volumes, organizational structure, security and compliance guidelines and so on. I recommend taking a look at this blog post which provides an architecture that incorporates many best practices and has been successfully implemented by many customers.
ㅤ
ㅤ
Please upvote/accept this answer if you found it helpful
In order to create a data lake on AWS you can consider the AWS Lake Formation[1] offering. AWS Lake Formation enables you to set up a secure data lake. You can store your data as-is, without having first to structure it.
You can also run different types of analytics to better guide decision-making—from dashboards and visualizations, to big data processing, real-time analytics, and machine learning.
Further, Lake Formation provides its own permissions model that augments the IAM permissions model. This centrally defined permissions model enables fine-grained access to data stored in data lakes through a simple grant or revoke mechanism, much like a relational database management system (RDMS).
Lake Formation permissions are enforced using granular controls at the column, row, and cell-levels across AWS analytics and machine learning services, including Amazon Athena, Amazon QuickSight, and Amazon Redshift.
You can also review other AWS Services that can be integrated with Lake Formation at: [+] AWS service integrations with Lake Formation - https://docs.aws.amazon.com/lake-formation/latest/dg/service-integrations.html
Due to the vast potential that Lake Formation presents, you are not just limited to using RDS and can explore other methods using service integrations and find a solution tailored to your particular use case. One such solution could be to integrate AWS Glue data Catalog and crawlers[2].
For a beginners guide please refer to the AWS Blog "Getting started with AWS Lake Formation": [+] https://aws.amazon.com/blogs/big-data/getting-started-with-aws-lake-formation/
Lastly, to understand your particular use case better and provide a tailored solution, we may require details that are non-public information. Please open a support case with AWS using the following link: [+] https://console.aws.amazon.com/support/home#/case/create
References:
[1] What is AWS Lake Formation? - https://docs.aws.amazon.com/lake-formation/latest/dg/what-is-lake-formation.html
[2] Data Catalog and crawlers in AWS Glue - https://docs.aws.amazon.com/glue/latest/dg/catalog-and-crawler.html
相关内容
- AWS 官方已更新 3 年前
- AWS 官方已更新 1 年前
- AWS 官方已更新 2 年前
- AWS 官方已更新 1 年前