scann-optimization

Enable learned SCANN indexing on billion-to-trillion-scale vector datasets.

Updated Dec 30, 2025
One-click install
npx skills add https://github.com/Rigohl/MEMORY_P --skill scann-optimization
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: scann-optimization
Source: https://github.com/Rigohl/MEMORY_P/tree/main/.github/skills/scann-optimization
Command: npx skills add https://github.com/Rigohl/MEMORY_P --skill scann-optimization

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

SCANN optimization resolves the challenge of scalable, accurate nearest-neighbor search for massive vector datasets by leveraging learned indexing and advanced quantization techniques.

Core Features & Use Cases

  • Learned indexing using neural networks to partition high-dimensional spaces
  • Anisotropic vector quantization for improved compression and recall
  • Enterprise-scale performance tuning with TensorFlow integration
  • Use Case: accelerate recommendations or search across billions of embeddings with high recall

Quick Start

Run a one-shot initialization of a SCANN index on your embedding dataset and evaluate recall vs latency to guide deployment.

Frequently Asked Questions about scann-optimization

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I scale vector search to billions of embeddings while maintaining high recall?

Learned SCANN indexing solves scalable vector search by using neural networks to partition high-dimensional spaces, enabling high-recall searches across billion-to-trillion-scale enterprise embedding datasets.

What is anisotropic quantization and how does it improve vector search recall?

Anisotropic vector quantization improves vector search by compressing embeddings more effectively, which preserves critical spatial information and enhances recall rates while reducing overall memory footprint.

Can I use TensorFlow integration to tune enterprise-scale vector search parameters?

Yes, TensorFlow integration enables enterprise-scale performance tuning for vector search, allowing you to evaluate recall versus latency tradeoffs and guide deployment on massive embedding datasets.

How do I initialize a SCANN index on an embedding dataset to evaluate recall and latency?

Run a one-shot initialization of a SCANN index on your embedding dataset to evaluate recall versus latency, directly guiding your deployment strategy for large-scale vector search.

When do I need learned indexing for vector search instead of traditional nearest-neighbor approaches?

You need learned indexing for vector search when accelerating recommendations or search across billions of embeddings, where traditional nearest-neighbor methods fail to meet enterprise recall and latency requirements.