I'm using Mistral models (specifically Mistral Large) to process data. The System Prompt doesn't change between the calls, only "user message" (which is the data). So, token usage can be greatly reduc...
I've been using Mistral Large 3 on Bedrock since it was launched about two weeks ago. It works really well, but since yesterday, output has suddenly been degraded. I've tried changing model parameters...
I am using Bedrock to access Mistral 2 Large, with converse_stream API. I am using tools too.
I get this message back:
BedrockManager - ERROR - get_model_response_stream failed: An error occurred (...