En utilisant AWS re:Post, vous acceptez les AWS re:Post Conditions d’utilisation
AWS re:Postre:Post

Glue Job store in "Temporary path" files, is it safe to delete this files periodically in scheduled job?

0

In Glue Jobs "Temporary path" specified s3 buckets folder we have bunch of files, is it safe to delete this files periodically? Does this affect on "Job bookmark" or some functionality in Glue Job?

Sujets
Analytique
Balises
AWS Glue
Langue
English
Data engineer
demandé il y a 7 mois486 vues
1 réponse
0

The temporary directory is used mainly for Redshift and relationalize temporary files, once the job has completed it is safe to delete. Won't delete bookmarks.
If you know the maximum time a job can run, you can provide a safe expiration policy so files never expire mid run.

profile pictureAWS
EXPERT
Gonzalo Herreros
répondu il y a 7 mois
profile picture
EXPERT
Giovanni Lauria
vérifié il y a 2 mois

Vous n'êtes pas connecté. Se connecter pour publier une réponse.

Une bonne réponse répond clairement à la question, contient des commentaires constructifs et encourage le développement professionnel de la personne qui pose la question.

Instructions pour répondre aux questions

Contenus pertinents