1 Antwort
- Neueste
- Die meisten Stimmen
- Die meisten Kommentare
0
Hello. I've recorded this 6 minutes video showing how to get Spark UI working.
In the video I cover all the steps needed including:
- VPC setup
- S3 buckets creation
- Glue connection creation (to ensure no public traffic is used)
- Glue job creation (and association with Glue connection)
- Spark UI usage
Let me know if you want to access the recording.
Please accept this answer. Otherwise, reply this question with more information about your glue job for us to troubleshoot.
References: https://docs.aws.amazon.com/glue/latest/dg/monitor-spark-ui-jobs.html https://docs.aws.amazon.com/glue/latest/dg/monitor-spark-ui.html
Regards, Pablo Silva
beantwortet vor einem Monat
Relevanter Inhalt
- AWS OFFICIALAktualisiert vor 3 Jahren
- AWS OFFICIALAktualisiert vor 2 Jahren
- Wie behebe ich den Fehler „java.lang.OutOfMemoryError: Java heap space“ in einem AWS Glue-Spark-Job?AWS OFFICIALAktualisiert vor 2 Jahren
@Pablo Silva - Could you please share the video. I see the logs have been created in S3 bucket, however, its failing in the parsing step.