All Content tagged with Amazon SageMaker Deployment

Amazon SageMaker provides a broad selection of machine learning (ML) infrastructure and model deployment options to help meet your needs, whether real time or batch. Once you deploy a model, SageMaker creates persistent endpoints to integrate into your applications to make ML predictions (also known as inference). It supports the entire spectrum of inference, from low latency (a few milliseconds) and high throughput (hundreds of thousands of inference requests per second) to long-running inference for use cases such as natural language processing (NLP) and computer vision (CV). Whether you bring your own models and containers or use those provided by AWS, you can implement MLOps best practices using SageMaker to reduce the operational burden of managing ML models at scale.

Content language: English

Select up to 5 tags to filter
Sort by most recent
I am curious about trying canvas, and I was wondering if I can use the models I build in canvas the same way I use the models I have built using automl. Specifically will I be able to use the...
1
answers
0
votes
24
views
asked 10 days ago
Hi, I created a postgres RDS database which I configured and was able to connect via pgAdmin. However when I try to connect to the db via code, I get timeout error For context my vpc security group...
2
answers
0
votes
100
views
Ahsan
asked 23 days ago
I am new to AWS and I do not understand a lot things here. I have a trained LSTM model in <model-name>.keras format. I am looking to deploy this model as a batch transformer. I have a custom script...
1
answers
0
votes
244
views
Tjaz
asked 3 months ago
I am the root user of my aws account ann when I try to create a sagemaker deployment project. I get this error. "You are not authorized to use the Amazon SageMaker project templates. Please contact...
1
answers
0
votes
177
views
PhilipN
asked 3 months ago
Hi, I have a docker container containing a custom inference script that keeps failing on endpoint creation with the following error: CannotStartContainerError. Please ensure the model container for...
1
answers
0
votes
199
views
asked 3 months ago
Hi, I want to deploy a model to sagemaker, however this model takes In different weights depending on some scenarios. Is there any way that I can deploy an endpoint which is able to use different...
1
answers
0
votes
229
views
NelioB
asked 5 months ago
Hi, I've constructed a pipeline using Scikit-Learn on SageMaker, incorporating data transformations and a Random Forest model, then I use the hyperparameter tuner to find the best model. I can...
0
answers
0
votes
122
views
asked 6 months ago
I create a Sagemaker Shadow Test to compare shadow variant with production variant and passed s3 URI to store prediction results of shadow vairant. I have sent more than 100 request to the prod...
0
answers
0
votes
71
views
Ashu
asked 6 months ago
Hi, Our sagemaker endpoints (async mode) are randomly failing. Here is a snippet of the data-log log stream : ``` 2024-03-05T17:40:10.207-05:00 2024-03-05T22:40:05.261:[sagemaker logs]...
0
answers
1
votes
256
views
John
asked 6 months ago
Hello all, I have an async endpoint running a model on SageMaker. I want my endpoint to be on for an hour (±3600 segs), and if after that time there's no activity i want to decrease the number of...
0
answers
0
votes
79
views
Tad
asked 7 months ago
# tl;dr 1. I have added a custom logger.debug("### calling modelfn.") into my model_fn. 2. the custom logger is inconsistently showing or not-showing in cloud-watch (despite no change on my side). #...
0
answers
0
votes
245
views
talao
asked 7 months ago
Hi , I am trying to delete sage maker domain , I have two users in that , when I am trying to delete users I am getting this error . `ResourceInUse Unable to delete UserProfile...
2
answers
0
votes
1496
views
asked 8 months ago