AWS Glue python shell job is supporting only python 3.6, but boto3 is now stopping its support to python 3.6

0

As per this aws doc, boto3 is stopping its support for python 3.6 from May 30, 2022. But in AWS Glue jobs - python shell, glue is supporting only python version 3.6 and its not even allowing us to update the python version. How should I handle my glue jobs now?

demandé il y a 2 ans1096 vues
3 réponses
1
dpevrli
répondu il y a 2 ans
0

AWS Glue version 2.0 and above support python version 3.7. https://docs.aws.amazon.com/glue/latest/dg/release-notes.html

To use python version above 3.6, consider migrating your Glue job to version 2.0 or 3.0. https://docs.aws.amazon.com/glue/latest/dg/migrating-version-30.html

répondu il y a 2 ans
  • Thanks for the response. But that doc is talking about spark jobs whereas my glue jobs are python shell. And for python shell glue version is 1.0 only, it doesn’t support 2.0

0

Hello,

we recently added support for python 3.9 in Glue Python Shell scripts. With this release we also added more libraries out of the box and simplified how you can install additional libraries.

For more details please refer to this blog post.

hope this helps

AWS
EXPERT
répondu il y a 2 ans

Vous n'êtes pas connecté. Se connecter pour publier une réponse.

Une bonne réponse répond clairement à la question, contient des commentaires constructifs et encourage le développement professionnel de la personne qui pose la question.

Instructions pour répondre aux questions