1 Answer
- Newest
- Most votes
- Most comments
2
No, it is not possible to run Amazon EMR on Amazon EKS Anywhere. Amazon EKS Anywhere is a managed Kubernetes service that allows you to run Kubernetes in any environment, whether connected or disconnected from AWS.
However, Amazon EMR is a managed cluster service that is optimized to run on AWS infrastructure like EC2 instances or EKS clusters. Please bear in mind the following:
- EKS Anywhere does not integrate with the Kubernetes Cluster API Provider for AWS, which is required for EMR to provision and manage clusters.
- EMR relies on various AWS services under the hood for features like automated scaling, monitoring, logging etc. These would not be available on EKS Anywhere clusters outside of AWS.
- Managing EMR clusters involves using AWS APIs and CLI commands. This level of integration with AWS control plane would not translate to other environments.
If your requirement is to run EMR workloads on-premises without an internet connection to AWS, then EKS Anywhere is not suitable. The best option would be to install and manage the open-source Hadoop/Spark components directly on an on-prem Kubernetes cluster.
Relevant content
- asked 2 years ago
- asked 2 years ago
- asked 2 years ago
- AWS OFFICIALUpdated 3 months ago
- AWS OFFICIALUpdated 2 years ago
- AWS OFFICIALUpdated 2 years ago
- AWS OFFICIALUpdated 2 years ago
Thank you so much for your support.