SageMaker JumpStart question

0

Hello,

I am new to Amazon SageMaker and trying to use Mistral 7B instruct model from JumpStart. I get this error message when I press Deploy:

"Failed to deploy endpoint The account-level service limit 'ml.g5.2xlarge for endpoint usage' is 0 Instances, with current utilization of 0 Instances and a request delta of 1 Instances. Please use AWS Service Quotas to request an increase for this quota. If AWS Service Quotas is not available, contact AWS support to request an increase for this quota."

What should I do?

1 Risposta
2

Hi,

You should first check your Quota for such instances by going in the AWS Console to Service Quotas > AWS Services > AWS SageMaker and check in the quota list the service limits for endpoints to see if it is really 0 or not.

See some examples on my account

Enter image description here

Then, again from console, you will take to go Support and open a request for quota increaae via a ticket

Best,

Didier

profile pictureAWS
ESPERTO
con risposta 4 mesi fa

Accesso non effettuato. Accedi per postare una risposta.

Una buona risposta soddisfa chiaramente la domanda, fornisce un feedback costruttivo e incoraggia la crescita professionale del richiedente.

Linee guida per rispondere alle domande