Questions tagged with Amazon EMR Serverless
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
Trying to figure out if it's possible to use AWS Glue crawler to parse the spark stderr logs that are dumped from emr-serverless.
The logs are space delimited. I tried running a crawler against the...
0
answers
0
votes
168
views
asked 5 months agolg...
Is it safe to say that , in terms of availability EMR serverless would be a better option than EMR ?lg...
I found this [https://repost.aws/questions/QUvOaZvA5BT56skWO0iu2kZA/emr-in-2-azs-and-high-availability]() where it says EMR launch nodes in a single AZ only .
Considering there haven't been much...
1
answers
0
votes
172
views
asked 5 months agolg...
Hi, we are in the process of moving from EMR to EMR serveless. Currently we are converting our Airflow DAGS from EMR to EMR serverless format.
We are having trouble getting one of our steps to work...
1
answers
0
votes
251
views
asked 5 months agolg...
When using EMR 7.0.0 in EMR Serverless (have not tried EKS or EC2), after connecting to the application through a EMR Studio workspace, the pyspark kernel doesn't work in a notebook. It stays in...
1
answers
0
votes
351
views
asked 5 months agolg...
I am trying to use aws emr-serverless get-dashboard-for-job-run cli command to pull information from emr-serverless but am stumped. This command returns a url and auth token. If I go to the url, it...
0
answers
0
votes
135
views
asked 5 months agolg...
Hi team,
Could you please advise how to set the timezone property for a job in EMR serverless. We have created an application in the Singapore timezone,however, the current_timestamp function is...
0
answers
0
votes
115
views
asked 5 months agolg...
The application is working in EMR cluster , but failing in EMR serverless though the base image is emr 6.15.0
Accepted AnswerAmazon EMR Serverless
4
answers
0
votes
624
views
asked 6 months agolg...
I am trying to see if I can use EMR Serverless to serve as a compute engine for customers querying data in S3. But even with pre-initialized capacity, the simplest of queries possible (select 1+2 as...
1
answers
0
votes
195
views
asked 6 months agolg...
I run one application without pre-initialized capability in Emr serverless and thr explicit limit set to 40vCPUs, 300gb memory, 2000gb disk. After the every job execution, resources utilization and...
Accepted AnswerAmazon EMR Serverless
1
answers
0
votes
311
views
asked 6 months agolg...
We are using EMR serverless to process the data, but we find for the same data size, EMR serverless consume different amounts of resource, such as vCPU-hours, memoryGB-hours and storageGB-hours.
I...
1
answers
0
votes
199
views
asked 6 months agolg...
After setting up a Hadoop cluster on AWS, I've noticed that when I attempt to stop the instances once I'm done with my work for the day and plan to resume the next day, the instances are automatically...
1
answers
0
votes
302
views
asked 8 months agolg...
Hi 👋, I have a couple of questions in emr serverless networking configuration.
1. I know public subnet is not recommended in backend, but it is not allowed in emr serverless. Any reason why only...
Accepted AnswerAmazon EMR Serverless
1
answers
2
votes
638
views
asked 8 months agolg...