Questions tagged with Amazon EMR
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
* EMR Version: 6.15.0
* Spark Conf
* "spark.sql.catalog.spark_catalog": "org.apache.iceberg.spark.SparkSessionCatalog"
* "spark.sql.catalog.spark_catalog.catalog-impl":...
1
answers
0
votes
279
views
asked 4 months agolg...
Hi Team,
We are trying to setup hive with external metastore running in Aurora MySQL 8 , we are using emr 6.15.0 and we used the instructions from the AWS documentation .
We are able to successfully...
1
answers
0
votes
228
views
asked 4 months agolg...
The Zero ETL Integration for replicating data to Redshift from Aurora PostgreSQL is currently in "Preview", as [this post specifies...
1
answers
0
votes
255
views
asked 4 months agolg...
Is there a way to use s3-dist-cp to copy files from a bucket that uses Requestor payments?
2
answers
0
votes
301
views
asked 4 months agolg...
EMRFS write errorslg...
Upgrading from EMR versions 6.11 to 6.12 (even tried 7.0.0), I'm seeing these errors on the same exact job with the same resources - has something changed with how EMRFS has been implemented? What is...
1
answers
0
votes
764
views
asked 5 months agolg...
Good morning,
As recently, a vulnerability on Resource Manager has been exploited, we are worried and want to confirm with you about the impact....
2
answers
0
votes
241
views
asked 5 months agolg...
I am trying to install happybase package on Zeppelin notebook ( or for that matter any package ) . How do I do a pip install from a Zeppelin cell .
%pip or !pip is not recognized
2
answers
0
votes
218
views
asked 5 months agolg...
Is there a way to check the integrity of files copied with S3DistCp at the end of the copy, like DistCp checksum?
1
answers
0
votes
250
views
asked 5 months agolg...
EMR had 1 primary, 1 core and 5 task nodes. All 3 group of nodes were on demand (including task group). I didn't use spot purchasing for task group to avoid unexpected termination. But still EMR...
1
answers
0
votes
403
views
asked 5 months agolg...
In AWS EMR, I encountered the following error message when running a pyspark job, which ran successfully on my local machine.
> [System Error] Fail to delete the temp folder
Is there a way to...
Accepted AnswerAmazon EMR
1
answers
0
votes
236
views
asked 5 months agolg...
When using EMR 7.0.0 in EMR Serverless (have not tried EKS or EC2), after connecting to the application through a EMR Studio workspace, the pyspark kernel doesn't work in a notebook. It stays in...
1
answers
0
votes
336
views
asked 5 months agolg...
Hi,
We have an EMR cluster with multiple concurrent steps gets executed seamlessly. Not sure what happened certainly, but the step logs, application logs are not published to s3 from yesterday....
Accepted AnswerAmazon EMR
3
answers
0
votes
368
views
asked 5 months agolg...