Using Pytorch 2.0 with AWS Neuron on Inf1

Question

Pytorch 2.0.1 is backward compatible so it shall be fine to use it but when we tried to we got this error.

ImportError
Invalid dependency version torch==2.0.1+cu117. Expected torch==1.13.1

```

# Extract the version prefix from the torch-neuron package
    version_parts = __version__.split('.')
    version = '.'.join(version_parts[:3])
    if not __version__.startswith(torch.__version__):
        raise ImportError(  f'Invalid dependency version torch=={torch.__version__}. '
            f'Expected torch=={version}'
        ) from e
```

Answer

Hello,

Please note that as of now, AWS Neuron does not support PyTorch version 2.0. The current version that Neuron supports is 1.13 [1]

We recommend that you consider opening a case with AWS Support [2] so that our engineers can take a further look into this.

Thank you!

References:
[1] https://awsdocs-neuron.readthedocs-hosted.com/en/latest/frameworks/torch/index.html#pytorch-neuronx-main 
[2] https://support.console.aws.amazon.com/

Using Pytorch 2.0 with AWS Neuron on Inf1

Relevant content