Model deployment with internal data

0

Is it possible to deploy a model to an endpoint along with a large amount of data for it to use? (~50GB), this can be though of as an internal database for my model to use. I only require such functionality temporary, since I am trying to avoid using database services (e.g DynamoDB etc) for the moment.

Thanks

3 個答案
0

Your best bet is to put the data in S3 if possible. S3 integrates directly with SageMaker so it should be seamless.

profile pictureAWS
專家
已回答 1 年前
0

Yes the data is stored in S3. Do you mean I can simply download the data from S3 bucket using boto3 (say in the function the loads the model)?

Ori
已回答 1 年前
0

Yes. Here is a sample snippet of code

import boto3

s3 = boto3.client('s3')

s3.download_file('BUCKET_NAME', 'OBJECT_NAME', 'FILE_NAME')

s3 = boto3.client('s3')

with open('FILE_NAME', 'wb') as f: s3.download_fileobj('BUCKET_NAME', 'OBJECT_NAME', f)

profile pictureAWS
專家
已回答 1 年前

您尚未登入。 登入 去張貼答案。

一個好的回答可以清楚地回答問題並提供建設性的意見回饋,同時有助於提問者的專業成長。

回答問題指南