EMR Serverless "Run status"

0

My job is still running even though I have received the results. why is that ?? I have successfully go the results. Can I manually set the "Run status" as "Success" after I got result ? I mean are there any Pyspark code to do so ??

질문됨 일 년 전589회 조회
1개 답변
3

https://docs.aws.amazon.com/emr/latest/EMR-Serverless-UserGuide/jobs.html

If your job is still running even though you have received the results, it could be due to several reasons:

Long-running Spark Context: If you've set up a long-running Spark context or Spark session, the job might continue to run even after the specific computation is complete.

Delayed Shutdown: There might be a delay in shutting down the job or the underlying infrastructure, causing the job to appear as still running.

Status Update Delay: There might be a delay in updating the job's status in the EMR Console, causing it to show as still running even though it has been completed.

https://docs.aws.amazon.com/emr/latest/EMR-Serverless-UserGuide/jobs-spark.html

profile picture
전문가
답변함 일 년 전

로그인하지 않았습니다. 로그인해야 답변을 게시할 수 있습니다.

좋은 답변은 질문에 명확하게 답하고 건설적인 피드백을 제공하며 질문자의 전문적인 성장을 장려합니다.

질문 답변하기에 대한 가이드라인

관련 콘텐츠