EMR Serverless "Run status"

0

My job is still running even though I have received the results. why is that ?? I have successfully go the results. Can I manually set the "Run status" as "Success" after I got result ? I mean are there any Pyspark code to do so ??

posta un anno fa590 visualizzazioni
1 Risposta
3

https://docs.aws.amazon.com/emr/latest/EMR-Serverless-UserGuide/jobs.html

If your job is still running even though you have received the results, it could be due to several reasons:

Long-running Spark Context: If you've set up a long-running Spark context or Spark session, the job might continue to run even after the specific computation is complete.

Delayed Shutdown: There might be a delay in shutting down the job or the underlying infrastructure, causing the job to appear as still running.

Status Update Delay: There might be a delay in updating the job's status in the EMR Console, causing it to show as still running even though it has been completed.

https://docs.aws.amazon.com/emr/latest/EMR-Serverless-UserGuide/jobs-spark.html

profile picture
ESPERTO
con risposta un anno fa

Accesso non effettuato. Accedi per postare una risposta.

Una buona risposta soddisfa chiaramente la domanda, fornisce un feedback costruttivo e incoraggia la crescita professionale del richiedente.

Linee guida per rispondere alle domande