AWS Glue python shell job is supporting only python 3.6, but boto3 is now stopping its support to python 3.6

0

As per this aws doc, boto3 is stopping its support for python 3.6 from May 30, 2022. But in AWS Glue jobs - python shell, glue is supporting only python version 3.6 and its not even allowing us to update the python version. How should I handle my glue jobs now?

asked 2 years ago1079 views
3 Answers
0

AWS Glue version 2.0 and above support python version 3.7. https://docs.aws.amazon.com/glue/latest/dg/release-notes.html

To use python version above 3.6, consider migrating your Glue job to version 2.0 or 3.0. https://docs.aws.amazon.com/glue/latest/dg/migrating-version-30.html

answered 2 years ago
  • Thanks for the response. But that doc is talking about spark jobs whereas my glue jobs are python shell. And for python shell glue version is 1.0 only, it doesn’t support 2.0

0

Hello,

we recently added support for python 3.9 in Glue Python Shell scripts. With this release we also added more libraries out of the box and simplified how you can install additional libraries.

For more details please refer to this blog post.

hope this helps

AWS
EXPERT
answered 2 years ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions