Sagemaker Processing Job does not terminate itself

0

Hello,

I am trying to do some simple preprocessing to my data, to be specific, I am trying to split my data into train, test and validation set. I want to make use of the processing job feature and have written a script for it.

However, when I executed the code to create a processor and run it, it says it is creating the processing script and continues running for more than 20mins, even though I only have 1400 examples in my dataset. I had to manually stop it and when I check the cloud logs, the last line of the preprocessing script is already executed, meaning the script ran properly and completely. The output can also be found in the s3 bucket. So my question is, why my processing job is not terminated automatically?

Andy
demandé il y a un mois92 vues
1 réponse
0

Please find the below document for reference - default of 86400 seconds (1 day) and the maximum value is 777600 (9 days). https://docs.aws.amazon.com/sagemaker/latest/APIReference/API_ProcessingStoppingCondition.html#sagemaker-Type-ProcessingStoppingCondition-MaxRuntimeInSeconds

profile pictureAWS
répondu il y a un mois
  • Hi, thanks a lot for the input. One thing that is still confusing to me is, why doesn't the processing job end itself after it executed my script completely? Is it necessary that we always set the maximum timeout time for the job?

Vous n'êtes pas connecté. Se connecter pour publier une réponse.

Une bonne réponse répond clairement à la question, contient des commentaires constructifs et encourage le développement professionnel de la personne qui pose la question.

Instructions pour répondre aux questions