Glue Job store in "Temporary path" files, is it safe to delete this files periodically in scheduled job?

0

In Glue Jobs "Temporary path" specified s3 buckets folder we have bunch of files, is it safe to delete this files periodically? Does this affect on "Job bookmark" or some functionality in Glue Job?

feita há 7 meses486 visualizações
1 Resposta
0

The temporary directory is used mainly for Redshift and relationalize temporary files, once the job has completed it is safe to delete. Won't delete bookmarks.
If you know the maximum time a job can run, you can provide a safe expiration policy so files never expire mid run.

profile pictureAWS
ESPECIALISTA
respondido há 7 meses
profile picture
ESPECIALISTA
avaliado há 2 meses

Você não está conectado. Fazer login para postar uma resposta.

Uma boa resposta responde claramente à pergunta, dá feedback construtivo e incentiva o crescimento profissional de quem perguntou.

Diretrizes para responder a perguntas