AWS Builder Center is the official home for builders on AWS. Share and read what others are working on, follow people who inspire you, explore training and workshops, and find tools to support what you're building.
How do I troubleshoot an AWS Glue streaming job?
I want to troubleshoot my failed AWS Glue streaming job.
Resolution
Use Amazon CloudWatch to monitor AWS Glue streaming job metrics. Then, check the failed streaming job's logs for error messages, warnings, or timestamps. For more information, see Gathering AWS Glue troubleshooting information.
Verify that the job's data sources and sinks are accessible and configured correctly. For more information, see Input sources and Output sinks on the Apache Spark website.
Use AWS Glue Schema Registry to discover, control, and evolve data stream schemas. Verify that the input data schemas match the expected schemas in the streaming job.
Before you deploy the streaming job, use AWS Glue Docker images or AWS Glue ETL library to develop and test it locally.
Related information
Relevant content
asked 10 months ago
asked 3 years ago
- AWS OFFICIALUpdated 2 years ago
- AWS OFFICIALUpdated 3 years ago
