Bedrock: 1 model unit = how many tokens/min throughput?

4

No where in the docs does it actually say what 1 model unit = how many tokens/min throughput. I'm sure this is different per model. There are on-demand pricing examples but the only provisioned example has model units with no token information.

Bedrock: 1 model unit = how many tokens/min throughput?

dres
preguntada hace 8 meses985 visualizaciones
2 Respuestas
0

See: https://docs.aws.amazon.com/bedrock/latest/userguide/quotas.html#quotas-runtime It highlights "Tokens processed per minute" for each model. And yes, its different for different models.

rkt
respondido hace 2 meses
-3

Open a ticket to get these details from support.

AWS
EXPERTO
respondido hace 8 meses
  • I did. They couldn’t. This isn’t an answer nor is it helpful

  • if don't know the answer don't answer please

No has iniciado sesión. Iniciar sesión para publicar una respuesta.

Una buena respuesta responde claramente a la pregunta, proporciona comentarios constructivos y fomenta el crecimiento profesional en la persona que hace la pregunta.

Pautas para responder preguntas