1 回答
- 最新
- 投票最多
- 评论最多
0
【以下的回答经过翻译处理】 这是一篇关于如何部署最大的BLOOM模型(176B参数)的博客:https://aws.amazon.com/blogs/machine-learning/deploy-bloom-176b-and-opt-30b-on-amazon-sagemaker-with-large-model-inference-deep-learning-containers-and-deepspeed/
对于较小的模型,您可以利用SageMaker Jumpstart:https://aws.amazon.com/blogs/machine-learning/run-text-generation-with-gpt-and-bloom-models-on-amazon-sagemaker-jumpstart/。