How can I scale up or scale out an OpenSearch Service domain?

3 minute read
0

I want to scale up or scale out an Amazon OpenSearch Service domain.

Resolution

Based on your workload, you can scale out (scale horizontally) or scale up (scale vertically) your cluster. To scale out your OpenSearch Service domain, add additional nodes, such as data nodes, master nodes, or UltraWarm nodes to your cluster. To scale up your domain, increase your Amazon Elastic Block Store (Amazon EBS) volume size. Or, add more memory and vCPUs with bigger node types.

Note: When you scale up or out, it's a best practice to use at least three dedicated master nodes for production workloads.

Scale out your domain

To scale out your domain, add nodes of the same configuration type as your current cluster nodes. As a result, you also add more resources, such as memory, vCPU, and EBS volume, to your cluster.

The maximum Amazon EBS volume size depends on the node's Amazon Elastic Compute Cloud (Amazon EC2) instance type. If you reach the Amazon EBS volume size quota and can't modify the instance type, then add more nodes. When you add more nodes to your cluster, you increase the cluster's Amazon EBS volume size. If you add more data nodes to your cluster, use data nodes or UltraWarm nodes. Keep your accessed indices on standard data nodes and use UltraWarm nodes to migrate less frequently accessed data.

To automate the migration of data from hot nodes to warm nodes, use an Index State Management (ISM) policy.

Scale up your domain

When you scale up your OpenSearch Service domain, you don't add additional nodes to your cluster. Instead, you increase the available resources for each of your nodes.

To add more memory or CPU resources when you scale up your domain, switch to a larger instance type.

Note: When you scale up your domain, Amazon EBS volume size doesn't automatically scale up. You must specify this setting if you want the Amazon EBS volume size to automatically scale up.

Update your domain configuration settings

To scale your OpenSearch Service domain, update your domain configuration settings. Complete the following steps:

  1. Open the OpenSearch Service console.
  2. From the navigation pane, under Managed clusters, choose Domains.
  3. Select the domain that you want to scale.
  4. Choose Actions, and then choose Edit cluster configuration.
  5. Update your domain configuration settings to meet your use case:
    For Data nodes, configure your Availability Zones, instance family, instance type, and number of nodes.
    For Storage configuration, update your data node storage type, Amazon EBS volume type, and Amazon EBS storage size per node.
    For Dedicated master nodes, turn on or turn off the dedicated master node. Then, update the instance type, or modify the number of master nodes.
    For UltraWarm data nodes, turn on or turn off UltraWarm data nodes. Then, update the instance type, or modify the number of UltraWarm data nodes.
  6. Choose Submit.
    Note: OpenSearch Service uses a blue/green deployment process when you update your domain. If you start a blue/green deployment process, then the number of nodes in your cluster might temporarily increase. For more information, see Making configuration changes in Amazon OpenSearch Service.
  7. Configure your Amazon CloudWatch alarms to monitor your resource utilization. For example, set an alarm that notifies you when CPUUtilization is above 80%.

Related information

Why did my OpenSearch Service node crash?

Troubleshooting Amazon OpenSearch Service

Supported operations in Amazon OpenSearch Service

AWS OFFICIAL
AWS OFFICIALUpdated 4 months ago