1 Respuesta
- Más nuevo
- Más votos
- Más comentarios
0
https://docs.aws.amazon.com/glue/latest/dg/aws-glue-programming-etl-format-json-home.html https://docs.aws.amazon.com/glue/latest/dg/custom-classifier.html
Please see the documentation provided. First you need to create a glue crawler to infer the schema from the JSON file. Then create glue job to read the JSON data and write to RDS. You can see sample reference below.
https://docs.aws.amazon.com/glue/latest/dg/aws-glue-programming-python-samples-legislators.html https://catalog.us-east-1.prod.workshops.aws/workshops/ee59d21b-4cb8-4b3d-a629-24537cf37bb5/en-US/lab6/custom-connector/load-data-to-rds https://github.com/aws-samples/aws-glue-samples
Contenido relevante
- OFICIAL DE AWSActualizada hace 3 años
- OFICIAL DE AWSActualizada hace 6 meses
- OFICIAL DE AWSActualizada hace 3 años
@SriniV - thanks . I will go through the links you provided. The part where crawler infers schema from s3 bucket , can that also be a glue job?
yes you can. Please see for reference https://repost.aws/knowledge-center/glue-crawler-detect-schema