By using AWS re:Post, you agree to the AWS re:Post Terms of Use
AWS re:Postre:Post

inf2 vs inf1 difference in bert output

0

Hi,

I have some code which generates a shape of torch.Size([1, 512, 1024] when calling bert on inf1. I have compiled the model for inf2. However the same code on inf2 produces a shape of torch.Size([1, 2]) . What could be the issue? Has anyone faced anything similar?

Topics
Machine Learning & AICompute
Tags
AWS InferentiaAWS Neuron
Language
English
rePost-User-6132983
asked a year ago281 views
1 Answer
0

This really is not enough information to get going with, please share the test code that produces this result

AWS
mrnikwaws
answered 10 months ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions

Relevant content