EMR Serverless "Run status"

0

My job is still running even though I have received the results. why is that ?? I have successfully go the results. Can I manually set the "Run status" as "Success" after I got result ? I mean are there any Pyspark code to do so ??

已提问 1 年前575 查看次数
1 回答
3

https://docs.aws.amazon.com/emr/latest/EMR-Serverless-UserGuide/jobs.html

If your job is still running even though you have received the results, it could be due to several reasons:

Long-running Spark Context: If you've set up a long-running Spark context or Spark session, the job might continue to run even after the specific computation is complete.

Delayed Shutdown: There might be a delay in shutting down the job or the underlying infrastructure, causing the job to appear as still running.

Status Update Delay: There might be a delay in updating the job's status in the EMR Console, causing it to show as still running even though it has been completed.

https://docs.aws.amazon.com/emr/latest/EMR-Serverless-UserGuide/jobs-spark.html

profile picture
专家
已回答 1 年前

您未登录。 登录 发布回答。

一个好的回答可以清楚地解答问题和提供建设性反馈,并能促进提问者的职业发展。

回答问题的准则