skills.rest
EngineerWithAI
EngineerWithAIOFFICIAL
Explore all skills by this author →
GitHub

vector-index-tuning

Tune HNSW parameters and quantization strategies for Qdrant vector indexes.

4|Updated Jan 10, 2026
Search Tags:#vector database#performance tuning#qdrant#quantization#search optimization#hns
One-click install
npx skills add https://github.com/EngineerWithAI/engineerwith-agents --skill vector-index-tuning-engineerwithai
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: vector-index-tuning
Source: https://github.com/EngineerWithAI/engineerwith-agents/tree/main/plugins/llm-application-dev/skills/vector-index-tuning
Command: npx skills add https://github.com/EngineerWithAI/engineerwith-agents --skill vector-index-tuning-engineerwithai

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires hnswlib, scikit-learn, qdrant-client, numpy, and includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill addresses the challenge of optimizing vector index performance, ensuring efficient retrieval of relevant information from large datasets while balancing latency, recall, and memory usage.

Core Features & Use Cases

  • HNSW Parameter Tuning: Adjust M, efConstruction, and efSearch for optimal recall and speed.
  • Quantization Strategies: Implement INT8 scalar, Product Quantization (PQ), or binary quantization to reduce memory footprint.
  • Index Configuration: Create Qdrant collections with settings tailored for recall, speed, memory, or a balanced approach.
  • Performance Monitoring: Profile index build times and benchmark search latency and recall.
  • Use Case: When deploying a large-scale similarity search system, use this Skill to fine-tune HNSW parameters and select an appropriate quantization strategy to meet strict latency requirements and memory constraints.

Quick Start

Use the vector-index-tuning skill to recommend HNSW parameters for a dataset of 500,000 vectors targeting 95% recall.

Frequently Asked Questions about vector-index-tuning

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I tune HNSW parameters for optimal vector search recall and speed?▼

Reduce vector search memory footprint by implementing INT8 scalar, Product Quantization (PQ), or binary quantization. This Skill helps select the right quantization strategy to meet memory constraints.

What's the best way to reduce vector search latency for a large-scale Qdrant index?▼

Reduce vector search latency by configuring Qdrant collections with tailored index settings. This Skill profiles index build times and benchmarks search latency to optimize large-scale similarity search infrastructure.

How does quantization affect vector database memory usage and recall?▼

Quantization reduces vector database memory usage by compressing vectors into INT8 scalar, Product Quantization (PQ), or binary formats. This Skill evaluates trade-offs between memory savings and recall accuracy.

Can I use hnswlib with scikit-learn for vector index performance tuning?▼

Yes, you can use hnswlib and scikit-learn for vector index performance tuning. This Skill leverages those libraries alongside qdrant-client and numpy for deterministic HNSW tuning and quantization execution.

How do I balance recall versus speed when configuring a 500,000 vector similarity search system?▼

Balance recall versus speed by fine-tuning HNSW parameters and selecting appropriate quantization strategies. This Skill recommends settings to achieve specific targets like 95% recall for 500,000 vector datasets.

Related Skills

Explore More Software Engineering Skills→
GregsGreyCodeGregsGreyCode
6

faiss

Perform scalable vector similarity search over embeddings with FAISS indices.

Community
Intermediate
twjarviszyra-webtwjarviszyra-web
3

qdrant-vector-search

Build Qdrant vector search systems for semantic retrieval and recommendation workflows.

Community
Advanced
ccfccf

vector-index-tuning

Tune HNSW parameters and quantization for large-scale vector search indexes.

Community
Advanced
hung-phanhung-phan

vector-db

Select and optimize vector databases for approximate nearest neighbor tasks.

Community
Advanced