Sagemaker Processing Job does not terminate itself

0

Hello,

I am trying to do some simple preprocessing to my data, to be specific, I am trying to split my data into train, test and validation set. I want to make use of the processing job feature and have written a script for it.

However, when I executed the code to create a processor and run it, it says it is creating the processing script and continues running for more than 20mins, even though I only have 1400 examples in my dataset. I had to manually stop it and when I check the cloud logs, the last line of the preprocessing script is already executed, meaning the script ran properly and completely. The output can also be found in the s3 bucket. So my question is, why my processing job is not terminated automatically?

Andy
已提問 1 個月前檢視次數 92 次
1 個回答
0

Please find the below document for reference - default of 86400 seconds (1 day) and the maximum value is 777600 (9 days). https://docs.aws.amazon.com/sagemaker/latest/APIReference/API_ProcessingStoppingCondition.html#sagemaker-Type-ProcessingStoppingCondition-MaxRuntimeInSeconds

profile pictureAWS
已回答 1 個月前
  • Hi, thanks a lot for the input. One thing that is still confusing to me is, why doesn't the processing job end itself after it executed my script completely? Is it necessary that we always set the maximum timeout time for the job?

您尚未登入。 登入 去張貼答案。

一個好的回答可以清楚地回答問題並提供建設性的意見回饋,同時有助於提問者的專業成長。

回答問題指南