EMR Serverless "Run status"

0

My job is still running even though I have received the results. why is that ?? I have successfully go the results. Can I manually set the "Run status" as "Success" after I got result ? I mean are there any Pyspark code to do so ??

demandé il y a un an590 vues
1 réponse
3

https://docs.aws.amazon.com/emr/latest/EMR-Serverless-UserGuide/jobs.html

If your job is still running even though you have received the results, it could be due to several reasons:

Long-running Spark Context: If you've set up a long-running Spark context or Spark session, the job might continue to run even after the specific computation is complete.

Delayed Shutdown: There might be a delay in shutting down the job or the underlying infrastructure, causing the job to appear as still running.

Status Update Delay: There might be a delay in updating the job's status in the EMR Console, causing it to show as still running even though it has been completed.

https://docs.aws.amazon.com/emr/latest/EMR-Serverless-UserGuide/jobs-spark.html

profile picture
EXPERT
répondu il y a un an

Vous n'êtes pas connecté. Se connecter pour publier une réponse.

Une bonne réponse répond clairement à la question, contient des commentaires constructifs et encourage le développement professionnel de la personne qui pose la question.

Instructions pour répondre aux questions