Whether you're taking your first steps with Kubernetes or you're an experienced practitioner looking to sharpen your skills, our Amazon EKS workshop series delivers practical, real-world experience that moves you forward. Learn directly from AWS solutions architects and EKS specialists through hands-on sessions designed to build your confidence with Kubernetes. Register now and start building with Amazon EKS!
Amazon OpenSearch Service: Distinctive Features That Set It Apart
Curated resources for Evaluating Amazon OpenSearch Service and its AI/ML Capabilities
In recent times, many customers have shown interest in migrating from legacy cloud or on-premises search solutions to the Amazon OpenSearch Service—both in its provisioned and serverless forms. During these evaluations, several recurring questions have emerged around areas such as AI/ML capabilities, alerting and notification features, recent innovations like User Behavior Insights and the Hybrid Optimizer, security and IAM integrations, operational best practices, and available training resources. While much of this information exists across various documentation and media, it can be difficult to locate in one place. To help streamline the evaluation and migration process, here is a curated collection of links to relevant blogs, videos, and documentation. This list will be updated as new content becomes available.
OpenSearch documentation :
- Opensource: https://opensearch.org/ , https://opensearch.org/blog/
- Amazon OpenSearch Service Provisioned: https://docs.aws.amazon.com/opensearch-service/latest/developerguide/what-is.html
- Amazon OpenSearch Serverless: https://docs.aws.amazon.com/opensearch-service/latest/developerguide/serverless.html
Looking to build smarter AI search?
Do you have the right insights to move ahead with the build ? Check out some thoughts and references that would get you started on building smarter search.
Migration to OpenSearch:
- https://aws.amazon.com/solutions/implementations/migration-assistant-for-amazon-opensearch-service/
- https://docs.aws.amazon.com/pdfs/prescriptive-guidance/latest/opensearch-service-migration/opensearch-service-migration.pdf
- The migration hub: https://aws.amazon.com/opensearch-service/migrations/
Monitoring & Dashboard
-
Opensearch UI: https://docs.aws.amazon.com/opensearch-service/latest/developerguide/application.html
-
https://docs.aws.amazon.com/opensearch-service/latest/developerguide/monitoring-data.html
Security Integrations:
Cognito & SAML
- https://docs.aws.amazon.com/opensearch-service/latest/developerguide/cognito-auth.html
- https://docs.aws.amazon.com/opensearch-service/latest/developerguide/fgac-iam.html
- https://aws.amazon.com/blogs/big-data/use-saml-identities-for-programmatic-access-to-amazon-opensearch-service/
- https://docs.aws.amazon.com/opensearch-service/latest/developerguide/serverless-saml.html
User Behavior Insights project & associated project :
Operational Best Practices
-
https://docs.aws.amazon.com/opensearch-service/latest/developerguide/bp.html
-
https://docs.aws.amazon.com/opensearch-service/latest/developerguide/sizing-domains.html
Benchmarking
https://opensearch.org/benchmarks/
Learning material
Courses on skillbuilder
Course-1: Implement Lexical Search Using Amazon OpenSearch Service:
Course-2: Empower Search with AI using Amazon OpenSearch Service:
Course-3: Building Retrieval Augmented Generation (RAG) Workflows with Amazon OpenSearch Service:
DIY Workshop:
- Getting started with OpenSearch Serverless: https://catalog.us-east-1.prod.workshops.aws/workshops/f8d2c175-634d-4c5d-94cb-d83bbc656c6a/en-US
- Getting started with “provisioned” OpenSearch Service: https://catalog.us-east-1.prod.workshops.aws/workshops/f0213896-4dd9-494a-89c5-f7886b45ed4a/en-US
- Pre-trained models: https://docs.opensearch.org/docs/latest/ml-commons-plugin/pretrained-models/ supported
Advanced Topics:
Managing embedding :
OpenSearch Neural plugin
https://opensearch.org/docs/2.4/neural-search-plugin/index/
Local model , for POC purpose
https://www.youtube.com/watch?v=uLQPyvzdTVQ&t=26s
Remote model , for production workload
- https://aws.amazon.com/blogs/big-data/power-neural-search-with-ai-ml-connectors-in-amazon-opensearch-service/
- https://www.youtube.com/watch?v=SYXCJLwaGZc
- https://www.youtube.com/watch?v=YlT9yQQajeA&t=540s
Neural Sparse search
- https://www.youtube.com/watch?v=_ipMfd7RuNk&list=PLzgr9zSpws166-ndhm5W49L9bJmiWjsrm&index=29
- https://opensearch.org/blog/improving-document-retrieval-with-sparse-semantic-encoders/
- https://aws.amazon.com/blogs/big-data/integrate-sparse-and-dense-vectors-to-enhance-knowledge-retrieval-in-rag-using-amazon-opensearch-service/
Chunking processors & Text Embedding processor
- https://opensearch.org/docs/latest/ingest-pipelines/processors/text-chunking/
- https://opensearch.org/docs/latest/tutorials/vector-search/semantic-search/long-document/
- https://opensearch.org/docs/latest/ingest-pipelines/processors/text-embedding/
- RFC: https://github.com/opensearch-project/neural-search/issues/1177
Build RAG , with OpenSearch Flow, Soon-to-launch OpenSearch Flow framework –
- https://docs.aws.amazon.com/opensearch-service/latest/developerguide/ml-workflow-framework.html
- Workshop: https://catalog.workshops.aws/opensearch-ml-search/en-US.
Demos - ML Playground
- https://www.youtube.com/watch?v=A5AmrniMWqk&t=17s
- https://ml.playground.opensearch.org/app/dashboards#/view/a1bf6d30-386a-11ee-9722-4db7dec6a234?_g=(filters:!(),refreshInterval:(pause:!t,value:0),time:(from:now-15m,to:now))&_a=(description:'',filters:!(),fullScreenMode:!f,options:(hidePanelTitles:!t,useMargins:!t),query:(language:kuery,query:''),timeRestore:!f,title:demo_landing_page,viewMode:view)
