Questions tagged with Amazon EMR Serverless
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
When using EMR 7.0.0 in EMR Serverless (have not tried EKS or EC2), after connecting to the application through a EMR Studio workspace, the pyspark kernel doesn't work in a notebook. It stays in...
1
answers
0
votes
314
views
asked 4 months agolg...
I am trying to use aws emr-serverless get-dashboard-for-job-run cli command to pull information from emr-serverless but am stumped. This command returns a url and auth token. If I go to the url, it...
0
answers
0
votes
127
views
asked 4 months agolg...
Hi team,
Could you please advise how to set the timezone property for a job in EMR serverless. We have created an application in the Singapore timezone,however, the current_timestamp function is...
0
answers
0
votes
109
views
asked 4 months agolg...
The application is working in EMR cluster , but failing in EMR serverless though the base image is emr 6.15.0
Accepted AnswerAmazon EMR Serverless
4
answers
0
votes
534
views
asked 5 months agolg...
I am trying to see if I can use EMR Serverless to serve as a compute engine for customers querying data in S3. But even with pre-initialized capacity, the simplest of queries possible (select 1+2 as...
1
answers
0
votes
176
views
asked 5 months agolg...
I run one application without pre-initialized capability in Emr serverless and thr explicit limit set to 40vCPUs, 300gb memory, 2000gb disk. After the every job execution, resources utilization and...
Accepted AnswerAmazon EMR Serverless
1
answers
0
votes
243
views
asked 5 months agolg...
We are using EMR serverless to process the data, but we find for the same data size, EMR serverless consume different amounts of resource, such as vCPU-hours, memoryGB-hours and storageGB-hours.
I...
1
answers
0
votes
173
views
asked 5 months agolg...
After setting up a Hadoop cluster on AWS, I've noticed that when I attempt to stop the instances once I'm done with my work for the day and plan to resume the next day, the instances are automatically...
1
answers
0
votes
280
views
asked 7 months agolg...
Hi 👋, I have a couple of questions in emr serverless networking configuration.
1. I know public subnet is not recommended in backend, but it is not allowed in emr serverless. Any reason why only...
Accepted AnswerAmazon EMR Serverless
1
answers
2
votes
549
views
asked 7 months agolg...
I'm running into an issue where I have certain properties, such as EMR secret resolution and package resolution that are not working when I define them as spark defaults in the job configuration file...
0
answers
0
votes
116
views
asked 8 months agolg...
We have a pyspark job which we are executing to connect with MongoDB using the mongo-spark-connector.
The job is executed successfully with no errors in the stdout log file and in the stderr log file...
1
answers
0
votes
432
views
asked 8 months agolg...
Please help me understand the difference between the three( EMR , ECS And EMR studio) , and when any of these should be used as all three are used for managing and creating clusters. Thanks
1
answers
0
votes
511
views
asked 8 months agolg...