Questions tagged with Amazon EMR Serverless
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
I am executing pyspark script on EMR serverless and i am using AWS step function for creating EMR application and submitting job in it. I want to know how to add logging option in AWS step function...
1
answers
0
votes
605
views
asked 3 months agolg...
I have a Serverless EMR appication, I am submitting a spark job via python script. I have packaged all the dependencies an an the script to an s3 bucket. When I execute the job the spark job is...
2
answers
0
votes
510
views
asked 3 months agolg...
Made an emr application with custom resources - specifically changed executors have more cores and more memory (different amount of memeory from default change for that number of cores, but within the...
0
answers
0
votes
141
views
asked 3 months agolg...
Hello everyone,
I created a spark_ready.py module that hosts multiple classes that I want to use as a template. I've seen in multiple configurations online that using the "spark.submit.pyFiles" will...
2
answers
0
votes
575
views
asked 3 months agolg...
question deletedlg...
question deleted question deleted
0
answers
0
votes
158
views
asked 3 months agolg...
Is there an option to run parallel jobs in emr serverless application natively
Accepted AnswerAmazon EMR Serverless
2
answers
0
votes
672
views
asked 3 months agolg...
How do I connect EMR Serverless to read and write to a Microsoft SQL Server database hosted on EC2
1
answers
0
votes
250
views
asked 3 months agolg...
We are running into `No space left on device` errors in EMR Serverless for big jobs, even when setting driver / executor drive size to the maximum 200GB.
I tried to make the S3 shuffle storage...
1
answers
0
votes
246
views
asked 3 months agolg...
The job is submitted from MWAA airflow. However, the job failed in airflow and EMR Serverless. The status is mentioned as "The job is pending scheduling" in EMR serverless.
Below is the log captured...
2
answers
0
votes
828
views
asked 3 months agolg...
Hi Experts,
Is there any way we can cancel the job run from the job itself ?. instead of cancelling it from the cancel job api ?.
1
answers
0
votes
163
views
asked 4 months agolg...
hello i'am using EMR Notebook attached to EMR Serverless Application.
i'm wondering how can i get the pricing information? there's nowhere i can find about the price how much i used.
when i execute...
2
answers
0
votes
240
views
asked 4 months agolg...
AWS EMR: Unexpected error when trying to retrieve Serverless applications. Please try again later.lg...
I have created an EMR studio, a serverless application and a workspace. I followed the steps described in the documentation [Getting started with EMR...
0
answers
0
votes
176
views
asked 4 months agolg...