upgrading to latest version of transformers for machine learning in sagemaker?

I'm running some experiments which requires transformer version greater than 4.17. to upgrade to latest , can i simply install newer version in my own container ?

Dockerfile

FROM 763104351884.dkr.ecr.us-east-1.amazonaws.com/huggingface-pytorch-inference:1.10.2-transformers4.17.0-gpu-py38-cu113-ubuntu20.04

RUN pip install 'transformers==4.24.0'

주제

기계 학습 및 AI

태그

AWS 딥 러닝 컨테이너 아마존 SageMaker 기계 학습 및 AI

언어

English

clouduser

질문됨 일 년 전546회 조회

1개 답변

최신
최다 투표
가장 많은 댓글

이 답변이 도움이 되었나요?커뮤니티가 여러분의 지식을 활용할 수 있도록 정답을 찬성하세요.

Hi,

The more canonical way to do such update in Python is to use the file 'requirements.txt' (that should probably also be present in your image at top of your python project) and update the project with the version you need and then run pip install -r requirements.txt.

See https://learnpython.com/blog/python-requirements-file/ for more details

Best,

Didier

전문가

Didier_Durand

답변함 일 년 전

upgrading to latest version of transformers for machine learning in sagemaker?

관련 콘텐츠