1 réponse
- Le plus récent
- Le plus de votes
- La plupart des commentaires
0
Hi,
This article demonstrates the use of Nvidia T4 for a 11B parameter model:
https://www.philschmid.de/deploy-t5-11b
AWS offers this GPU: https://aws.amazon.com/ec2/instance-types/g4/
those blog posts provide detailled examples of large-scale ML infrastructures on AWS cloud
- https://aws.amazon.com/blogs/machine-learning/achieve-high-performance-at-scale-for-model-serving-using-amazon-sagemaker-multi-model-endpoints-with-gpu/
- https://aws.amazon.com/blogs/machine-learning/create-train-and-deploy-a-billion-parameter-language-model-on-terabytes-of-data-with-tensorflow-and-amazon-sagemaker/
- https://aws.amazon.com/blogs/machine-learning/train-175-billion-parameter-nlp-models-with-model-parallel-additions-and-hugging-face-on-amazon-sagemaker/
- https://aws.amazon.com/blogs/machine-learning/how-latent-space-used-the-amazon-sagemaker-model-parallelism-library-to-push-the-frontiers-of-large-scale-transformers/
Contenus pertinents
- demandé il y a 5 mois
- demandé il y a 2 mois
- demandé il y a 3 mois
- AWS OFFICIELA mis à jour il y a 2 ans
- AWS OFFICIELA mis à jour il y a 3 ans
- AWS OFFICIELA mis à jour il y a un an
- AWS OFFICIELA mis à jour il y a 4 mois