pgvectorscale-diskann

Enables memory-efficient large-scale vector search on PostgreSQL using DiskANN and SBQ.

Updated Apr 22, 2026

Search Tags:#embeddings #scaling #vector #diskann #pgvectorscale #memory-optimized

Ready to run

npx skills add https://github.com/Mercurium-Analytics/pg-search-vector --skill pgvectorscale-diskann

💬 Prompt for ChatGPT / Claude Chat▼

Please help me install this Agent Skill.
Skill: pgvectorscale-diskann
Source: https://github.com/Mercurium-Analytics/pg-search-vector/tree/main/skills/pgvectorscale-diskann
Command: npx skills add https://github.com/Mercurium-Analytics/pg-search-vector --skill pgvectorscale-diskann

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Large-scale vector search demands more RAM than is affordable, making naive HNSW impractical for 100M+ vectors. DiskANN with pgvectorscale enables memory-efficient indexing and query processing on commodity hardware.

Core Features & Use Cases

DiskANN-based index for large embeddings with streaming access.
SBQ-based vector compression to shrink index memory footprint with minimal recall loss.
Suitable for RAG pipelines, knowledge bases, and enterprise document corpora requiring scalable vector search.

Quick Start

Create a StreamingDiskANN index for your embeddings (vector(768)) using SBQ storage and run a sample top-10 nearest-neighbor query.

Frequently Asked Questions about pgvectorscale-diskann

High-intent search queries and answers about installing and using this skill.

FAQPage Schema

How do I scale vector search beyond RAM limits in PostgreSQL?▼

You can scale vector search beyond RAM limits in PostgreSQL by using DiskANN with pgvectorscale, which enables memory-efficient indexing and streaming access for large-scale enterprise vector workloads.

What is the best way to index 100M+ embeddings without exhausting server memory?▼

The best way to index 100M+ embeddings without exhausting memory is using DiskANN combined with SBQ vector compression via pgvectorscale, shrinking the index memory footprint with minimal recall loss.

Does pgvectorscale support DiskANN for enterprise document corpora?▼

Yes, pgvectorscale supports DiskANN for enterprise document corpora, providing a StreamingDiskANN index and SBQ compression to handle large-scale vector search workloads efficiently on commodity hardware.

How do I create a StreamingDiskANN index for vector embeddings?▼

To create a StreamingDiskANN index, configure a vector(768) column in PostgreSQL with pgvectorscale, enable SBQ storage, and apply per-table index tuning to run sample top-10 nearest-neighbor queries.

What are the limitations of using naive HNSW for large-scale vector search?▼

The main limitation of naive HNSW for large-scale vector search is that it demands more RAM than is affordable, making it impractical for 100M+ vectors on commodity hardware without DiskANN.