Questions tagged with Generative AI on AWS
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
Getting inference error with Flan-T5 XXL BNB INT8 model. "Input payload must include text input key"lg...
I am following this blog to do RAG with Kendra, LLM, Langchain, and sagemaker Jumpstart....
2
answers
0
votes
323
views
asked 10 months agolg...
Current the AI21 models have a $0.0 software cost.
This is based of the Preview of AWS? Or it is Forever.
Exact Question:
### The inference Cost (Without Hardware) of the AI21 Models will be...
2
answers
0
votes
282
views
asked a year agolg...
I have a customer request to test summarizing data from URL links and I believe AI21Labs can do that but cannot find an example with the model deployed via Jumstart. Is this possible?
2
answers
0
votes
389
views
Hi team,
My VS Code Codewhisperer could give me only 1 code suggestion. It did not provide nor allow me to choose other alternative suggestions via using left/right cursors.
When I placed the same...
3
answers
0
votes
1765
views
asked a year agolg...
When i try to sign in using AWS Builder ID I just get
```
-> TypeError: Cannot destructure property 'id' of 'undefined' as it is undefined.
2023-05-04 13:55:18 [WARN]: auth: failed to logout of...
1
answers
1
votes
911
views
asked a year agolg...
I am initializing an `inf1.6xlarge` Sagemaekr instance via
```
sudo tee /etc/yum.repos.d/neuron.repo > /dev/null <<EOF
[neuron]
name=Neuron YUM...
1
answers
0
votes
536
views
asked a year agolg...
Github copilot doesn't has a support for R programming and niether codewhisperer mentions it in its supported languages. Was wondering if Codewhisperer has been tried for R?
1
answers
0
votes
613
views
asked a year agolg...
I would like to fine-tune large language models (starting with 10+B parameters) on Sagemaker.
Since we are working with Pytorch and Lightning the idea would be to use DeepSpeed in combination with...
1
answers
1
votes
783
views
asked a year agolg...
I enabled code whisperer in intellij ide. We are using kotlin for building our backend services.
I am not seeing any code recommendation for kotlin from code whisperer. Wondering will it work for...
2
answers
0
votes
841
views
asked a year agolg...
Which aws service should we start with to build a chatbot with our private data in AWS? Should we go to Kendra or any LLM solution?
1
answers
0
votes
1865
views
asked a year agolg...
Dear developers,
I am relatively new to AWS and EC2 instances. I have an EC2 Inf1 instance and I am trying to set up tensorflow neuron for deep learning applications.
When I running the 'Resnet50...
2
answers
0
votes
338
views
asked a year agolg...
Diffusers aren't yet supported for deployment on Inf instances?
If they already are, what docs could be the guide to achieve it?
Beforehand, thank you.
1
answers
0
votes
265
views
asked a year agolg...