Model deployment with internal data

0

Is it possible to deploy a model to an endpoint along with a large amount of data for it to use? (~50GB), this can be though of as an internal database for my model to use. I only require such functionality temporary, since I am trying to avoid using database services (e.g DynamoDB etc) for the moment.

Thanks

3 回答
0

Your best bet is to put the data in S3 if possible. S3 integrates directly with SageMaker so it should be seamless.

profile pictureAWS
专家
已回答 1 年前
0

Yes the data is stored in S3. Do you mean I can simply download the data from S3 bucket using boto3 (say in the function the loads the model)?

Ori
已回答 1 年前
0

Yes. Here is a sample snippet of code

import boto3

s3 = boto3.client('s3')

s3.download_file('BUCKET_NAME', 'OBJECT_NAME', 'FILE_NAME')

s3 = boto3.client('s3')

with open('FILE_NAME', 'wb') as f: s3.download_fileobj('BUCKET_NAME', 'OBJECT_NAME', f)

profile pictureAWS
专家
已回答 1 年前

您未登录。 登录 发布回答。

一个好的回答可以清楚地解答问题和提供建设性反馈,并能促进提问者的职业发展。

回答问题的准则