Sagemaker Processing Job does not terminate itself

0

Hello,

I am trying to do some simple preprocessing to my data, to be specific, I am trying to split my data into train, test and validation set. I want to make use of the processing job feature and have written a script for it.

However, when I executed the code to create a processor and run it, it says it is creating the processing script and continues running for more than 20mins, even though I only have 1400 examples in my dataset. I had to manually stop it and when I check the cloud logs, the last line of the preprocessing script is already executed, meaning the script ran properly and completely. The output can also be found in the s3 bucket. So my question is, why my processing job is not terminated automatically?

1 Risposta
0

Please find the below document for reference - default of 86400 seconds (1 day) and the maximum value is 777600 (9 days). https://docs.aws.amazon.com/sagemaker/latest/APIReference/API_ProcessingStoppingCondition.html#sagemaker-Type-ProcessingStoppingCondition-MaxRuntimeInSeconds

profile pictureAWS
con risposta un mese fa
  • Hi, thanks a lot for the input. One thing that is still confusing to me is, why doesn't the processing job end itself after it executed my script completely? Is it necessary that we always set the maximum timeout time for the job?

Accesso non effettuato. Accedi per postare una risposta.

Una buona risposta soddisfa chiaramente la domanda, fornisce un feedback costruttivo e incoraggia la crescita professionale del richiedente.

Linee guida per rispondere alle domande