Questions tagged with Amazon EMR Serverless
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
Is it safe to say that , in terms of availability EMR serverless would be a better option than EMR ?lg...
I found this [https://repost.aws/questions/QUvOaZvA5BT56skWO0iu2kZA/emr-in-2-azs-and-high-availability]() where it says EMR launch nodes in a single AZ only .
Considering there haven't been much...
1
answers
0
votes
166
views
asked 5 months agolg...
Hi, we are in the process of moving from EMR to EMR serveless. Currently we are converting our Airflow DAGS from EMR to EMR serverless format.
We are having trouble getting one of our steps to work...
1
answers
0
votes
243
views
asked 5 months agolg...
When using EMR 7.0.0 in EMR Serverless (have not tried EKS or EC2), after connecting to the application through a EMR Studio workspace, the pyspark kernel doesn't work in a notebook. It stays in...
1
answers
0
votes
337
views
asked 5 months agolg...
I am trying to use aws emr-serverless get-dashboard-for-job-run cli command to pull information from emr-serverless but am stumped. This command returns a url and auth token. If I go to the url, it...
0
answers
0
votes
132
views
asked 5 months agolg...
Hi team,
Could you please advise how to set the timezone property for a job in EMR serverless. We have created an application in the Singapore timezone,however, the current_timestamp function is...
0
answers
0
votes
113
views
asked 5 months agolg...
The application is working in EMR cluster , but failing in EMR serverless though the base image is emr 6.15.0
Accepted AnswerAmazon EMR Serverless
4
answers
0
votes
598
views
asked 5 months agolg...
I am trying to see if I can use EMR Serverless to serve as a compute engine for customers querying data in S3. But even with pre-initialized capacity, the simplest of queries possible (select 1+2 as...
1
answers
0
votes
188
views
asked 5 months agolg...
I run one application without pre-initialized capability in Emr serverless and thr explicit limit set to 40vCPUs, 300gb memory, 2000gb disk. After the every job execution, resources utilization and...
Accepted AnswerAmazon EMR Serverless
1
answers
0
votes
288
views
asked 6 months agolg...
We are using EMR serverless to process the data, but we find for the same data size, EMR serverless consume different amounts of resource, such as vCPU-hours, memoryGB-hours and storageGB-hours.
I...
1
answers
0
votes
191
views
asked 6 months agolg...
After setting up a Hadoop cluster on AWS, I've noticed that when I attempt to stop the instances once I'm done with my work for the day and plan to resume the next day, the instances are automatically...
1
answers
0
votes
296
views
asked 7 months agolg...
Hi 👋, I have a couple of questions in emr serverless networking configuration.
1. I know public subnet is not recommended in backend, but it is not allowed in emr serverless. Any reason why only...
Accepted AnswerAmazon EMR Serverless
1
answers
2
votes
614
views
asked 8 months agolg...
I'm running into an issue where I have certain properties, such as EMR secret resolution and package resolution that are not working when I define them as spark defaults in the job configuration file...
0
answers
0
votes
122
views
asked 8 months agolg...