By using AWS re:Post, you agree to the AWS re:Post Terms of Use

EMR on EKS Anywhere

0

I want to run EMR On-Premises, no Spark.

The question, is possible to run EMR (https://aws.amazon.com/emr/) on EKS Anywhere (https://aws.amazon.com/es/eks/eks-anywhere/)

Also, we don't have support to run AWS Outposts.

profile picture
asked 9 months ago493 views
1 Answer
2
Accepted Answer

No, it is not possible to run Amazon EMR on Amazon EKS Anywhere. Amazon EKS Anywhere is a managed Kubernetes service that allows you to run Kubernetes in any environment, whether connected or disconnected from AWS.

However, Amazon EMR is a managed cluster service that is optimized to run on AWS infrastructure like EC2 instances or EKS clusters. Please bear in mind the following:

  • EKS Anywhere does not integrate with the Kubernetes Cluster API Provider for AWS, which is required for EMR to provision and manage clusters.
  • EMR relies on various AWS services under the hood for features like automated scaling, monitoring, logging etc. These would not be available on EKS Anywhere clusters outside of AWS.
  • Managing EMR clusters involves using AWS APIs and CLI commands. This level of integration with AWS control plane would not translate to other environments.

If your requirement is to run EMR workloads on-premises without an internet connection to AWS, then EKS Anywhere is not suitable. The best option would be to install and manage the open-source Hadoop/Spark components directly on an on-prem Kubernetes cluster.

profile picture
EXPERT
answered 9 months ago
profile picture
EXPERT
reviewed 8 months ago
profile picture
EXPERT
reviewed 9 months ago
  • Thank you so much for your support.

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions