SageMaker JumpStart question

Question

Hello,

I am new to Amazon SageMaker and trying to use Mistral 7B instruct model from JumpStart. I get this error message when I press Deploy:

"Failed to deploy endpoint
The account-level service limit 'ml.g5.2xlarge for endpoint usage' is 0 Instances, with current utilization of 0 Instances and a request delta of 1 Instances. Please use AWS Service Quotas to request an increase for this quota. If AWS Service Quotas is not available, contact AWS support to request an increase for this quota."

What should I do?

Answer

Hi,

You should first check your Quota for such instances by going in the AWS Console to Service Quotas > AWS Services > AWS SageMaker and check in the quota list the service limits for endpoints to see if it is really 0 or not.

See some examples on my account

![Enter image description here](/media/postImages/original/IMsXMsRCckSI6mgFLYG8gW_g)

Then, again from console, you will take to go Support and open a request for quota increaae via a ticket

Best,

Didier

SageMaker JumpStart question

Contenido relevante