2 Answers
- Newest
- Most votes
- Most comments
0
Hi There
You might find more info in the CLoudWatch logs (See the bottom of your error messge)
I have seen similar issues when trying to deploy other versions of LLava. In the meantime, here is a working notebook for deploying LLava 1.5 on Sagemaker. I have this running in my own account and it works great.
0
I encountered similar issues trying to deploy https://huggingface.co/liuhaotian/llava-v1.5-7b/tree/main to a SM EP. I'm not sure it works out-of-the-box with SageMaker. However I found https://huggingface.co/anymodality/llava-v1.5-7b, which is a fork of the model including explicit SageMaker support. That README gives instructions for downloading the model, which includes a Jupyter Notebook you can follow to deploy the endpoint
answered 2 months ago
Relevant content
- Accepted Answerasked 8 months ago
- AWS OFFICIALUpdated 9 months ago
- AWS OFFICIALUpdated 2 years ago
- AWS OFFICIALUpdated 2 years ago
- AWS OFFICIALUpdated a month ago