Sagemaker 批量转换

【以下的问题经过翻译处理】嗨，看起来Sagemaker Batch Transform 对payload有100MB的限制。我想针对一个5GB的csv文件运行preds，有什么推荐的方法吗？

Topics

Machine Learning & AI

Tags

Build & Train ML Models Amazon SageMaker Machine Learning & AI

Language

中文 (简体)

EXPERT

rePost Polyglot

asked 9 months ago61 views

1 Answer

Newest
Most votes
Most comments

Are these answers helpful? Upvote the correct answer to help the community benefit from your knowledge.

【以下的回答经过翻译处理】如果您使用“SplitType”： “Line”和“BatchStrategy”： “MultiRecord”，SageMaker Batch Transform将自动将输入文件拆分为指定的payload大小。除非您有非常大的单条记录，否则无需手动拆分文件或使用大的payload size。希望这可以帮助您！

EXPERT

rePost Polyglot

answered 9 months ago

Relevant content

Sites on Amplify become very slow recently. Amplify站点最近突然变得很慢。
Zhu
asked 10 months ago
如何讓 IAM 使用者只看的到自己建立的資源 ( How to allow IAM users to only see resources they have created.)
Accepted Answer
kerokero
asked 2 months ago
sagemaker美国人口普查数据在中国宁夏区下载提示拒绝访问
LiuChuang
asked a year ago
多网络接口，多ip地址配置路由策略，从那个公网ip进入就从对应的ip出去。
rePost-User-8489725
asked a year ago
How can I resolve the Amazon SageMaker inference error "upstream timed out (110: Connection timed out) while reading response header from upstream"?
AWS OFFICIALUpdated 2 years ago
How do I troubleshoot issues when I access an Amazon SageMaker Project in SageMaker Studio?
AWS OFFICIALUpdated a year ago
How do I use Amazon SageMaker Python SDK local mode with SageMaker Studio?
AWS OFFICIALUpdated a year ago
How can I troubleshoot Amazon SageMaker Ground Truth labeling errors?
AWS OFFICIALUpdated 2 years ago
Monitoring SageMaker Notebook Instance with CloudWatch Custom Metrics
EXPERT
Ben Lee
published 5 months ago
Build and Deploy Models Leveraging Cancer Gene Expression Data With SageMaker Pipelines and SageMaker Multi-Model Endpoints
EXPERT
Joshua_B
published 2 years ago