Questions tagged with Amazon EMR
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
Hello Team,
We are facing issues with EMR 6.10.0 SPARK(pyspark) Application and following are the details for it ,
1) Spark submit is failing in cluster mode for pyspark application
2) However we...
1
answers
1
votes
790
views
asked 9 months agolg...
Recurring Issue with AWS Athena When Running Queries on Iceberg Table.
Description
I am trying to run queries on an Iceberg table using AWS Athena. The data is stored in S3, and I am using EMR...
1
answers
0
votes
618
views
asked 9 months agolg...
Confirmed this by
- setting `s3.persistence.bucket` to the same value as in EMR 6.12, but my old notebooks did not appear,
- setting `s3.persistence.bucket` to a garbage value (i.e., non-existent...
1
answers
0
votes
264
views
asked 9 months agolg...
When I create an Iceberg table in AWS Athena in analogy to the example at the bottom of...
2
answers
0
votes
1386
views
asked 9 months agolg...
Did AWS charge any cost for Emr cluster during his creating&bootstrapping? Or cost charging only after cluster goes to "waiting" status?
1
answers
0
votes
401
views
asked 9 months agolg...
Why I got this issue when subnets and vpc are exist ??
Failed to create Workspace.
Invalid studio subnet configuration. All of the studio subnets are invalid/deleted. Please use a studio with valid...
1
answers
0
votes
274
views
asked 10 months agolg...
I am getting a validation error, when I try to create a managed endpoint for EMR on EKS.
```
{
"type": "JUPYTER_ENTERPRISE_GATEWAY",
"state": "TERMINATED_WITH_ERRORS",
"releaseLabel":...
1
answers
2
votes
431
views
asked 10 months agolg...
Hello everyone!
I'm seeking advice on architecture design using AWS, specifically regarding the feature store process. Currently, I'm in the prototyping phase and using the tsfresh library for...
1
answers
0
votes
221
views
asked 10 months agolg...
How to run a Hadoop Jar file (a mapreduce job) on EMR cluster in the CLI mode?
I have already set the cluster and have a jar file. However, I don't know how to use Hadoop to run the Jar file.
any...
1
answers
0
votes
559
views
asked 10 months agolg...
EMR Cluster Logslg...
How can I resolve ''S3 BUCKET NOT REACHABLE'' while trying to Publish Cluster-Specific logs to Amazon S3?
1
answers
0
votes
327
views
asked 10 months agolg...
Hi,
I am trying to read Excel file in Glue PySpark notebook.
I am using Crealytics Spark Excel package. I have added all the extra jars and packages through the magic commands, before creating the...
1
answers
0
votes
699
views
asked 10 months agolg...
I've been reading through documentation, but not able to find clear instruction on setup hive metastore in S3 for EMR Serverless, I only see examples of use glue cagtalog or aurora rds sql database....
1
answers
0
votes
916
views
asked 10 months agolg...