Questions tagged with Amazon EMR Serverless
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
I've followed the methods for adding Python libraries. Documentation here:
https://docs.aws.amazon.com/emr/latest/EMR-Serverless-UserGuide/using-python-libraries.html
Boto installs and loads...
1
answers
0
votes
407
views
asked a year agolg...
Hi,
we have a task to move Spark jobs from on-prem to AWS, using lift-and-shift of the code as much as possible. Our Spark is based on Scala 2.11 and Spark 2.4.0. I know EMR supports this version but...
1
answers
1
votes
494
views
asked a year agolg...
My job is still running even though I have received the results. why is that ??
I have successfully go the results.
Can I manually set the "Run status" as "Success" after I got result ? I mean are...
1
answers
0
votes
591
views
asked a year agolg...
I want to configure jar (deequ-2.0.1-spark-3.2.jar) on EMR serverless arm64.
This works for x86_64 but doesn't work for arm64 architecture.
Could you please consider this matter it gave this error...
2
answers
0
votes
555
views
asked a year agolg...
Hi Team,
I wanted to run spark application built using JDK 11 on EMR Serverless. Since the default image does not have support of JDK 11, I created the custom image based on following links:
Use...
Accepted AnswerAmazon EMR Serverless
1
answers
0
votes
630
views
asked a year agolg...
Hello,
today my EMR Serverless application suddenly decided to not start. It's staying in "Starting" state and won't reach "Started" state. Usually it starts in less than a minute, today I have...
1
answers
1
votes
613
views
asked a year agolg...
I'm working on EMR Serverless for validating of data located in s3 using deequ library. But I am Unable to do that , I got this error...
Traceback (most recent call last):
File...
1
answers
0
votes
849
views
asked a year agolg...
Hi,
I ran an ETL job in EMR serverless but I incurred Natgateway charges even though my emr application and s3 bucket is in the same region. I have also configured gateway endpoint to s3 in my vpc but...
1
answers
0
votes
364
views
asked a year agolg...
Hi.
I have set up an EMR Serverless application to run a simple Hello World spark job. I've configured everything properly and the job execution is successful.
Next, I've created a custom image...
1
answers
0
votes
689
views
asked a year agolg...
Hi! I'm excited to see EMR Serverless. I went through the quick start and was able to run the word count, pretty cool.
Now I would like to submit a spark job using command-runner.jar like I do on a...
1
answers
0
votes
1209
views
asked a year agolg...
Need to create an emr cluster with custom ubuntu image. While I tried to use market place ubuntu image to create the cluster, I got an error stating that EMR cluster can not be created with multiple...
1
answers
0
votes
279
views
asked a year agolg...
**Question**
Is there a limitation in EMR Serverless that prevents the `spark-streaming-kinesis-asl_2.12` library from reading / writing to the DynamoDb lease table? When running a kinesis streaming...
0
answers
0
votes
149
views
asked a year agolg...