In RDS for PostgreSQL 15.2, how do you set the number of probes for the pgvector extension?

0

For context see announcement of pgvector support in the RDS for PostgreSQL 15.2.

pgvector has a parameter called probes or ivfflat.probes. However when editing parameters for my database instance, I don't see a parameter containing "probes". The number of probes is critical for taking advantage of the ivfflat index using pgvector (see pgvector documentation for more detail). How do you set this parameter?

已提问 1 年前631 查看次数
1 回答
0

Hi there.

I'm reading the documentation and it seems this is set along with your code. It is a query option.

By default, pgvector performs exact nearest neighbor search, which provides perfect recall. You can add an index to use approximate nearest neighbor search, which trades some recall for performance. Unlike typical indexes, you will see different results for queries after adding an approximate index. Three keys to achieving good recall are:

  1. Create the index after the table has some data
  2. Choose an appropriate number of lists - a good place to start is rows / 1000 for up to 1M rows and sqrt(rows) for over 1M rows
  3. When querying, specify an appropriate number of probes (higher is better for recall, lower is better for speed) - a good place to start is sqrt(lists)

Add an index for each distance function you want to use.

This way, in your code you would just execute something like

BEGIN;
SET LOCAL ivfflat.probes = 10;
SELECT <your query>
COMMIT;

This doesn't look like a setting at the instance/database level but you set it on each query.

I hope this helps.

profile pictureAWS
专家
已回答 1 年前

您未登录。 登录 发布回答。

一个好的回答可以清楚地解答问题和提供建设性反馈,并能促进提问者的职业发展。

回答问题的准则