내용으로 건너뛰기

Index vs Search resource separation on Managed OpenSearch cluster on AWS

0

Hey,

Is there a way to allocate separate resources (in the form of nodes/threads etc.) for indexing vs searching on a Managed OpenSearch cluster on AWS?

It seems like this is possible in OpenSearch as we can separately allocate indexing and search capacity OCUs on OpenSearch Serverless.

Our issue is that we have heavy indexing traffic when we run certain jobs. This currently interferes with the latency of search requests. We are hoping to solve this by separating out the resources.

Appreciate the help! Thanks

2개 답변
0

In AWS Managed OpenSearch Service, you can’t directly allocate separate resources for these tasks.

Instead, you can optimize performance by choosing the right instance types and sizes, optimizing shard allocation, defining index mappings and settings, using parallel execution and scaling, and enabling cross-cluster search and replication.

전문가
답변함 2년 전
    • Understand that we can always provide more resources to the cluster overall.
    • How can shard allocation, index mapping help with resource contention between indexing and searching?
    • Re. cross-cluster search replication, are you suggesting a follower cluster as a read replica used only for searching?
0

Hello,

As you rightly pointed out OpenSearch serverless allows you to segregate the Search and Indexing workloads. But in OpenSearch service you can't allocate the resources for Search and Indexing requests.

Please follow below guide to improve indexing and search requests:

  1. https://repost.aws/knowledge-center/opensearch-indexing-performance
  2. https://repost.aws/knowledge-center/opensearch-latency-spikes

If you're running indexing heavy operational analytics workloads such as log analytics, observability, or security analytics, you can benefit from the improved performance and compute efficiency of OR1 instances. In addition, the automatic data recovery offered by OR1 instances improves the overall reliability of your domain. For more info, please refer the blog

AWS
지원 엔지니어
답변함 2년 전

로그인하지 않았습니다. 로그인해야 답변을 게시할 수 있습니다.

좋은 답변은 질문에 명확하게 답하고 건설적인 피드백을 제공하며 질문자의 전문적인 성장을 장려합니다.

관련 콘텐츠