Does AWS Bedrock's provisioned throughput increase claude's API request rate limits?

Question

The [docs](https://docs.anthropic.com/claude/reference/errors-and-rate-limits#rate-limits) from anthropic claude mention default API request rate limits per organization:

> Our rate limits are currently measured in number of concurrent requests across your organization, and will default to 1 while you’re evaluating the API. This means that your organization can make at most 1 request at a time to our API.
If you exceed the rate limit you will get a 429 error. Once you’re ready to go live we’ll discuss the appropriate rate limit with you.

- Does Bedrock's provisioned throughput increase the claude's default API request rate limits?
- If so, does provisioned 10 MU means at most you can make 10 requests at a time?

Accepted Answer

Hello, 
The Amazon Bedrock service is using an AWS managed deployment of the Anthropic Claude model which is not the same as when using Anthropic's API directly. As such, different limits apply to these services. Specifically for Bedrock Claude the current limit on demand is 400/100 requests per minute for the instant/claudev2 models respectively. Using Provisioned Throughput you can achieve higher rate limits. 
For more details on this please see: https://docs.aws.amazon.com/bedrock/latest/userguide/quotas.html

Does AWS Bedrock's provisioned throughput increase claude's API request rate limits?

Contenido relevante