Questions tagged with Amazon EMR Serverless
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
I am very new to MLOps and seeking guidance on how to put a piece of ML python code into production on AWS.
Here are my requirements:
1. Model is run once a week
2. Pick up very large data files from...
1
answers
0
votes
358
views
asked a year agolg...
Hello.
Could you advice what instruments is more suitable for migrate a Spark app to AWS? :
The Spark applicaiton is for change data only, without any UI. We started it time-to-time, may be several...
1
answers
0
votes
272
views
asked a year agolg...
* below CF stack is failing with this error "Resource handler returned message: Error occurred during operation 'CreateApplication'." (RequestToken: <some-token-id>, HandlerErrorCode:...
1
answers
0
votes
459
views
asked a year agolg...
Hi,
I finally got my pyspark code to mostly work using an EMR Serverless application, but according to the logs it seems like there is a particular problem with this line
```
if...
Accepted AnswerAmazon EMR Serverless
2
answers
0
votes
1072
views
asked a year agolg...
Hi,
are there any plans for EMR Serverless service to utilize Spot capacity? Similar e.g. to Fargate Spot for ECS.
Thank you,
Nikos
Accepted AnswerAmazon EMR Serverless
1
answers
0
votes
476
views
asked a year agolg...
I have an EMR Serverless PySpark job I am launching from a step function. I am trying to pass arguments to SparkSubmit from the entryPointArguments in the form of variables set in the beginning of the...
1
answers
0
votes
1331
views
asked a year agolg...
EMR serverless job Spark UI/history server is not accessible once application restart.
Application is configured with below options to reduce cost.
[Auto start application-
Automatically starts on...
1
answers
0
votes
974
views
asked a year agolg...
Hi,
I run EMR serverless jobs at the top of every hour. All the jobs are submitted to the same Application with no pre-initialized capacity. Is there any benefit from terminating the application...
2
answers
0
votes
1409
views
asked a year agolg...
I understand there are application limits for EMR serverless. But when there are multiple jobs running at the same time on the same application, is it possible for them to share workers' available...
1
answers
0
votes
694
views
asked a year agolg...
With Redshift Serverless you need a certain amount of available private IPs in your VPC, so I was wondering if it's similar here, and, if so, how many IPs?
1
answers
0
votes
544
views
asked a year agolg...
Is there a way to utilize EMR Serverless to run S3DistCp? Looking at the base Docker images, I can see that the `s3-dist-cp` command is included in the Hive image. How can I submit a job run that runs...
1
answers
0
votes
472
views
asked a year agolg...
Does EMR serverless use YARN for resource management? What is the default resource management tool used by EMR serverless?
1
answers
0
votes
571
views
asked a year agolg...