2 Answers
- Newest
- Most votes
- Most comments
2
Hi @Ashley Miller,
As of today, it is not possible to access Claude FM without Bedrock. It's not available on SageMaker JumpStart as well. If it seems okay, you can try other models from AI21 labs/Meta/Cohere from SageMaker JumpStart.
On the FedRAMP certification, Amazon Bedrock is undergoing 3rd party assessment. PFB the latest update here - https://aws.amazon.com/compliance/services-in-scope/FedRAMP/
Thanks,
answered a year ago
0
If you could overcome the following hurdles, then it's possible to run Claude outside of Bedrock.
- The license. You would need to work through Anthropic to gain the ability to deploy Claude to SageMaker. Claude is not available through the typical channels like Jumpstart or HuggingFace.
- Instance size. As of this writing it may be possible to run Claude on a P5 instance, but I'm not aware of a publicly reference-able successful deployment on Sagemaker. If you can get the container/wights/artifacts it's possible to work backwards to find the right instance. size. Please let us know if you are successful.
answered a year ago
Relevant content
- Accepted Answerasked 8 months ago
- asked 3 months ago
- AWS OFFICIALUpdated a month ago
- AWS OFFICIALUpdated 9 months ago
- AWS OFFICIALUpdated 6 months ago
- AWS OFFICIALUpdated 6 months ago