1 réponse
- Le plus récent
- Le plus de votes
- La plupart des commentaires
0
Hi THere
I think you are seeing this error (albeit misleading) due to max_tokens=30000
The maximum value for output is 4096. try setting max_tokens=4096
See
https://docs.anthropic.com/claude/docs/models-overview#model-comparison
Also keep in mind, # of token does not equal # of characters. Every model caluclates tokens a bit differently. For Anthropic Claude v2, 100k tokens is equal to apx 75k WORDS. See https://www.anthropic.com/news/100k-context-windows
Contenus pertinents
- demandé il y a un an
- demandé il y a un an
- AWS OFFICIELA mis à jour il y a 7 mois
- AWS OFFICIELA mis à jour il y a 4 mois