By using AWS re:Post, you agree to the AWS re:Post Terms of Use

Jamba 1.5 foundation model in Bedrock is broken.

0

I want to build an application using Jamba 1.5 model family from AI21 LAB. It has an error when I tried to invoke it. In bedrock playground, it gave me this error "The system encountered an unexpected error during processing. Try your request again.". Please can somebody from AWS fix this. I am using the model from "us-east-1" region.

1 Answer
1

The error message you're encountering ("The system encountered an unexpected error during processing. Try your request again.") is a general error that can occur for various reasons and doesn't necessarily indicate that the Jamba 1.5 model is broken. This type of error can be intermittent and often resolves itself with retries.

Here are some steps you can take to address this issue:

  1. Retry your request: As the error message suggests, try your request again. Sometimes, these errors are temporary and resolve on their own.

  2. Check your permissions: Ensure that your IAM user or role has the necessary permissions to invoke the model. You should have the "bedrock:InvokeModel" and "bedrock:InvokeModelWithResponseStream" actions allowed in your IAM policy.

  3. Verify region availability: Confirm that you're using the correct region. The Jamba 1.5 models are indeed available in the US East (N. Virginia) region, which aligns with your usage.

  4. Review your input: Make sure your input adheres to the model's requirements and doesn't exceed any limits.

  5. If the issue persists: If you continue to encounter this error after multiple attempts and after verifying your setup, it's recommended to contact AWS Support for further assistance.

Remember, the Jamba 1.5 model family (including Jamba 1.5 Large and 1.5 Mini) is designed for enterprise applications and offers advanced features like a 256k effective context window and improved speed on long contexts. These models are new additions to Amazon Bedrock, so occasional hiccups during the initial rollout period are not uncommon but are typically resolved quickly.
Sources
Jamba 1.5 family of models by AI21 Labs is now available in Amazon Bedrock - AWS
Resolve InvokeModel API error in Amazon Bedrock | AWS re:Post
AWS Bedrock - Claude Model invocations are raising Exception | AWS re:Post

profile picture
answered 2 months ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions