Sagemaker Processing Job does not terminate itself

0

Hello,

I am trying to do some simple preprocessing to my data, to be specific, I am trying to split my data into train, test and validation set. I want to make use of the processing job feature and have written a script for it.

However, when I executed the code to create a processor and run it, it says it is creating the processing script and continues running for more than 20mins, even though I only have 1400 examples in my dataset. I had to manually stop it and when I check the cloud logs, the last line of the preprocessing script is already executed, meaning the script ran properly and completely. The output can also be found in the s3 bucket. So my question is, why my processing job is not terminated automatically?

Andy
질문됨 한 달 전92회 조회
1개 답변
0

Please find the below document for reference - default of 86400 seconds (1 day) and the maximum value is 777600 (9 days). https://docs.aws.amazon.com/sagemaker/latest/APIReference/API_ProcessingStoppingCondition.html#sagemaker-Type-ProcessingStoppingCondition-MaxRuntimeInSeconds

profile pictureAWS
답변함 한 달 전
  • Hi, thanks a lot for the input. One thing that is still confusing to me is, why doesn't the processing job end itself after it executed my script completely? Is it necessary that we always set the maximum timeout time for the job?

로그인하지 않았습니다. 로그인해야 답변을 게시할 수 있습니다.

좋은 답변은 질문에 명확하게 답하고 건설적인 피드백을 제공하며 질문자의 전문적인 성장을 장려합니다.

질문 답변하기에 대한 가이드라인

관련 콘텐츠