All Content tagged with AWS Inferentia

AWS Inferentia is designed to provide high performance inference in the cloud, to drive down the total cost of inference, and to make it easy for developers to integrate machine learning into their business applications.

Content language: English

Filter content

Select tags to filter

Sort by

Sort by most recent

57 results

Now Available in Skill Builder: Compute - Knowledge Badge Re...

Markus AdhiwiyogoEXPERT

published a year ago0 votes254 views

New Training & Certification Badge from AWS

ARTICLE

Free AWS Virtual Training: Accelerating SLM Inference: Optim...

Markus AdhiwiyogoEXPERT

published a year ago0 votes218 views

Virtual training on choosing the optimal infrastructure for Small Language Models

ARTICLE

Machine Learning & AI AWS Graviton GPU Development AWS Trainium AWS Inferentia

Not found the "pytorch-1.13 environment for Inf1" in the “De...

[AWS Neuron Documentation](https://awsdocs-neuron.readthedocs-hosted.com/en/latest/general/setup/neuron-setup/multiframework/multi-framework-ubuntu22-neuron-dlami.html#setup-ubuntu22-multi-framework-d...

AWS Inferentia AWS Neuron

answers

votes

217

views

AWS-User-4165719

asked 2 years ago

Compiling a model for Inferentia or Trainium - fixing the No...

Burtoft, JimEXPERT

published 2 years ago1 votes531 views

Walk through the options for compiling a model for inference using Inferentia or Trainium. You would need to do this if the model or the configuration you want isn't available in the Hugging Face cac...

ARTICLE

Amazon SageMaker AWS Inferentia AWS Trainium Machine Learning & AI

Get started with DeepSeek R1 on AWS Inferentia and Trainium

KamranEXPERT

published 2 years ago3 votes5.6K views

Step by Step guide to deploy DeepSeek R1 Distilled models.

ARTICLE

AWS Neuron AWS Inferentia AWS Trainium

Getting started with Inferentia or Trainium

Burtoft, JimEXPERT

published 2 years ago0 votes658 views

A list of resources to use when you are first starting with the Neuron SDK and Inferentia or Trainium instances.

ARTICLE

AWS Inferentia AWS Trainium AWS Neuron

Remote development on an EC2 Inferentia, Trainium, or Neuron...

Burtoft, JimEXPERT

published 2 years ago0 votes1.2K views

Steps to set up Jupyter notebooks and VS Code remote server on Trainium and Inferentia Neuron systems.

ARTICLE

AWS Inferentia Machine Learning & AI AWS Trainium AWS Neuron

Get the latest on AWS AI Chips from re:Invent 2024

KamranEXPERT

published 2 years ago0 votes1.9K views

Key announcements and discover how industry leaders, like Apple and Anthropic, are revolutionizing AI with AWS Trainium and Inferentia

ARTICLE

AWS Inferentia Machine Learning & AI AWS Trainium AWS Neuron Generative AI on AWS

Easily get started with Amazon EC2 Inferentia2 or Trainium1 ...

Burtoft, JimEXPERT

published 2 years ago0 votes1.4K views

Get started with Inferentia and Trainium on EC2 using the Hugging Face Neuron Deep Learning Amazon Machine Image (AMI). A short walkthrough of how to deploy an EC2 image with all the Neuron drivers a...

ARTICLE

Amazon Machine Images (AMI)AWS Inferentia AWS Trainium AWS Neuron

Join us at AWS re:Invent 2024

KamranEXPERT

published 2 years ago0 votes1.3K views

Are you heading to **AWS re:Invent 2024** and looking for AWS Inferentia and Trainium sessions to take your machine learning skills to the next level?

ARTICLE

AWS Inferentia AWS Neuron AWS Trainium

What regions have AWS Inferentia and Trainium instances?

Burtoft, JimEXPERT

published 2 years ago1 votes3.6K views

See what regions have instances, and find out how to generate your own list with a python script.

ARTICLE

AWS Neuron AWS Trainium AWS Inferentia

Inference Recommendation fails due to image size error

Hello AWS team! I am trying to run a suite of inference recommendation jobs leveraging NVIDIA Triton Inference Server on a set of GPU instances (ml.g5.12xlarge, ml.g5.8xlarge, ml.g5.16xlarge) as well...

Serverless ML Ops with Amazon SageMaker and Kubernetes Amazon SageMaker AWS Lambda AWS Inferentia

answers

votes

views

Adrian

asked 2 years ago

1
2
3
4
5
Page size
12 / page