Sticky AWS Glue Notebook Sessions
1
I work a lot using AWS Glue Notebooks and I cannot find a way to restart sessions seamlessly. The use case is the following:
- I start a notebook
- After a while I need to change some config in the current session
- I restart the kernel
- The session goes in stopped state
- The %status magic returns: "There is no current session"
- When I attempt to recreate a session I get the following exception:
An error occurred (AlreadyExistsException) when calling the CreateSession operation: Session already created, sessionId=2167b01d-43a3-49e1-a2ee-c804e6940e83
The only workaround I found is to delete the session from the console manually. Not the best in my opinion. Is there a best way already available?
demandé il y a 9 mois801 vues
2 réponses
- Le plus récent
- Le plus de votes
- La plupart des commentaires
1
I have discovered that using the %stop_session magic works. The current session goes in the stopped state and is detached from the kernel. I would suggest to add a macro/widget to the notebook command bar.
répondu il y a 9 mois
0
Getting the same issue
répondu il y a 5 mois
The session is probably stopping but it has not stopped yet. When this happens to me I normally look for the session in the interactive session list and I check the state. Then I wait or a kill it manually.
Contenus pertinents
- demandé il y a 3 mois
- demandé il y a un an
- demandé il y a 8 mois
- demandé il y a un an
AWS OFFICIELA mis à jour il y a 2 ans- AWS OFFICIELA mis à jour il y a 3 ans
- AWS OFFICIELA mis à jour il y a 3 ans
Ideally it should just detect the kernel restart and do the stop and cleanup automatically, will open a request to see if that's possible
Had the same issue and "%stop_session" magic did the trick. Yes, doing this automatically upon kernel restart would be even better.