By using AWS re:Post, you agree to the AWS re:Post Terms of Use

Getting 'User input fails validation' when using imported LLM in bedrock playground

0

Hello,

I've imported an LLM to bedrock. It's a fine-tuned llama 3 8B model, but when I try to test it in the playground, I get 'User input fails validation'. This does not happen with FMs, and it did not happen a few weeks ago when testing the same imported model using the playground.

Please, let me know if you may use other details about the case.

Regards,

Luis

1 Answer
0

I apologize, but I don't have specific information about an error message stating "User input fails validation" when using an imported LLM in the Amazon Bedrock playground. This error message is not mentioned in the provided sources, and I don't have data about recent changes that might have caused this issue with imported models.

However, I can offer some general suggestions that might help:

  1. Double-check that your input is properly formatted for the Llama 3 8B model. Llama 3 models use a specific prompt format that includes special tokens.

  2. Ensure that you're using the correct API request format when interacting with the model. The Bedrock documentation in the AWS console may have an "API Request" section for each foundation model, but it's important to note that this might not always be sufficient for running the model successfully.

  3. If you're using a Lambda function to interact with the model, make sure you're formatting the prompt correctly. For Llama 3 models, the prompt needs to be nested inside specific formatting text.

  4. Verify that you have the necessary permissions and that your model import was successful.

  5. If the issue persists, it would be best to contact AWS Support or post your question on AWS re:Post for Amazon Bedrock to get more specific assistance with your imported model.

Without more details about your specific setup and the exact steps you're taking, it's difficult to pinpoint the exact cause of the error. If you can provide more information about how you imported the model and the exact steps you're taking in the playground, that might help in diagnosing the issue.
Sources
Meta Llama3 8B results are different than expected when triggered from lambda vs Bedrock Playground and other model execution testing | AWS re:Post
Meta Llama 3 models are now available in Amazon Bedrock | AWS News Blog

profile picture
answered a month ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions