Questions tagged with Amazon EMR
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
Hi
I am getting error while launching EMR with Hbase as S3Storage and WAL backup enabled .
Caused by: java.lang.RuntimeException: createWal failed for wal WALMetadata(WALWorkspace=testworkspace2,...
1
answers
0
votes
585
views
asked 2 months agolg...
I have a Python package saved in CodeCommit and need to use it in the notebook attached to my EMR cluster workspace.
The package is already successfully installed via bootstrap.
To do this, in my .sh...
1
answers
0
votes
481
views
asked 3 months agolg...
I have a Serverless EMR appication, I am submitting a spark job via python script. I have packaged all the dependencies an an the script to an s3 bucket. When I execute the job the spark job is...
2
answers
0
votes
496
views
asked 3 months agolg...
Hello,
I configured iceberg formatted table with transaction in hive on EMR 6.4.1. When I insert data into the table, the operation get stuck, without any error.
Any insights are highly...
Accepted AnswerAmazon EMR
1
answers
0
votes
431
views
asked 3 months agolg...
I've started seeing the following error on JupyterHub on EMR
`TypeError: required field "type_ignores" missing from Module`
from the simplest commands
![the...
2
answers
0
votes
442
views
asked 3 months agolg...
Hi Team,
We have EMR 6.10 cluster where flink jobs submitted to existing application. Container was running in task node in my case. Then I resized the task instance group from 1 to 0 in task instance...
Accepted AnswerAmazon EMR
1
answers
0
votes
327
views
asked 3 months agolg...
I need to load data from Kinesis Data Streams to EMR via EMR Studio. I Follow this sample but doesn't work: https://github.com/awslabs/spark-sql-kinesis-connector
1
answers
0
votes
1362
views
asked 3 months agolg...
EMR on EKS Anywherelg...
I want to run EMR On-Premises, no Spark.
The question, is possible to run EMR (https://aws.amazon.com/emr/) on EKS Anywhere (https://aws.amazon.com/es/eks/eks-anywhere/)
Also, we don't have support...
1
answers
0
votes
374
views
asked 3 months agolg...
I am working with Step Function, and I have a MAP type step to which I pass an S3 path in which there is a csv on which the MAP has to iterate. In each loop of the map, a script is executed with the...
2
answers
0
votes
432
views
asked 3 months agolg...
Inquiry Regarding Spark Application Performance Discrepancy Across AWS Accounts in the Same Regionlg...
**Overview:**
The Spark application in question is deployed within AWS Account A, specifically in the us-west-2 region.
This application reads data from and writes data to Amazon S3 buckets hosted in...
1
answers
0
votes
232
views
asked 4 months agolg...
EMR API call? Trying to determine if there an API call to determine if "Automatically apply latest Amazon Linux updates" for EMR cluster was checked..
1
answers
0
votes
301
views
asked 4 months agolg...
Hi team
We want to use an EMR Cluster to process data with spark jobs
We have 30,000 files per day and approximately 2Gb of information, later it is planned that this will grow.
We have a small...
1
answers
0
votes
307
views
asked 4 months agolg...