Installing linux headers (DLAMI AMI) failed in INF2 installation guide

Question

Hello, i'm using **pytorch-inference:2.0.1-gpu-py310-cu118-ubuntu20.04-sagemaker**  AMI and following this guide https://awsdocs-neuron.readthedocs-hosted.com/en/latest/general/setup/neuron-setup/pytorch/neuronx/ubuntu/torch-neuronx-ubuntu20-base-dlami.html#setup-torch-neuronx-ubuntu20-base-dlami to install tools and drivers. I. get error when i'm trying to install **sudo apt-get install linux-headers-$(uname -r) -y**. The error i get is 
`E: Unable to locate package linux-headers-4.14.326-245.539.amzn2.x86_64
E: Couldn't find any package by glob linux-headers-4.14.326-245.539.amzn2.x86_64
E: Couldn't find any package by regex linux-headers-4.14.326-245.539.amzn2.x86_64`
How can i make it work?

Answer

It looks like you are using the wrong AMI - you should not need to modify the base AMI. Please follow this link https://awsdocs-neuron.readthedocs-hosted.com/en/latest/general/devflows/inference/byoc-hosting-devflow-inf2.html and use a DLC from the 'Neuron Containers' section. These containers are all tested: https://github.com/aws/deep-learning-containers/blob/master/available_images.md#neuron-containers

Note we don't have PyTorch 2.0 support. PyTorch 2.1 support will be available in an upcoming release.

Note we don't have PyTorch 2.0 support.  PyTorch 2.1 support will be available in an upcoming release.

Installing linux headers (DLAMI AMI) failed in INF2 installation guide

Relevant content