Questions tagged with AWS Deep Learning Containers
AWS Deep Learning Containers (AWS DL Containers) are Docker images pre-installed with deep learning frameworks to make it easy to deploy custom machine learning (ML) environments quickly by letting you skip the complicated process of building and optimizing your environments from scratch.
Content language: English
Filter questions
Select tags to filter
Sort by
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
17 results
Huggingface (https://github.com/huggingface/text-embeddings-inference) has released the image to support the new embedding models of Qwen. I really need them for our project. But the latest tei-huggin...
Hi Team, I need some help here. IHAC needs to deploy an ONNX model using SageMaker. They scanned the latest Triton and DJL DL containers and found more than 1k vulnerabilities in different packages. T...
asked 5 months ago
I followed AWS tutorials to deploy a model on Sagemaker, but when the server deployed takes several minutes to process a request, it runs the same processing multiple times for an invocation. I report...
After fine-tuning a DistilBERT model and saving it as 'model.pth', and creating an 'inference.py' script, I packaged both into a '.tar.gz' file. Upon deploying it, an endpoint was successfully created...
Could you please explain in detail with example ?
Why we need the generative AI?
asked 2 years ago
Hi,
As part of ongoing development in our project, we hire designers to design UX/UI for Mobile Apps.
Hence in this context, can we have Bot(training engine) arranged so that we can train and use for...
I'm running some experiments which requires transformer version greater than 4.17. to upgrade to latest , can i simply install newer version in my own container ?
Dockerfile
```
FROM 763104351884.d...
We are fine-tuning stable diffusion model on a custom dataset and looking for the DreamBooth approach for training on Sagemaker. Is it possible on Sagemaker. if yes then can you give me some links or ...
When I have a look at https://github.com/aws/deep-learning-containers/blob/master/available_images.md I get many different deep learning containers with an example URL, for instance,
763104351884.dk...
I am deploying a Triton server endpoint on Sagemaker and I want to ssh into the instance where the endpoint is running for debugging purposes. I can't find a way to identify the instance (e.g. find th...
Hi, with the release of EKS 1.23 and 1.24 we are moving ever closer to the full removal of the PodSecurityPolicy. To replace this the PodSecurity admission controller has been graduated to the beta br...
Hello,
I've been trying to deploy multiple PyTorch models on one endpoint on SageMaker from a SageMaker Notebook. First I tested deployment of single models on single endpoints, to check if everything...