qdrant-relevance-feedback

Improves dense vector search relevance using Qdrant's Relevance Feedback API instead of reranking.

3|1|Updated Nov 30, 2025
One-click install
npx skills add https://github.com/PALabs-v1/AI_friend --skill qdrant-relevance-feedback-palabs-v1
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: qdrant-relevance-feedback
Source: https://github.com/PALabs-v1/AI_friend/tree/main/.claude/skills/qdrant-search-quality/search-strategies/relevance-feedback
Command: npx skills add https://github.com/PALabs-v1/AI_friend --skill qdrant-relevance-feedback-palabs-v1

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires qdrant-relevance-feedback.

What problem does it solve? Dense retrievers often miss relevant documents that fall outside the initial ANN search pool, and reranking a large candidate pool is expensive. This Skill guides you through using Qdrant's Relevance Feedback API to distill a feedback model's knowledge into the vector search itself, surfacing relevant documents the initial retrieval missed. ## Core Features & Use Cases - Weight Calibration: Train the RF formula weights (a, b, c) on 50-200 representative queries using the qdrant-relevance-feedback Python library before inference. - High-Precision Top Results: Score only 5 seed documents to achieve reranking-level top-1/top-3 precision at roughly one-fifth the scoring cost. - Recall Beyond the Initial Pool: Run a two-pass feedback workflow to discover relevant documents completely outside the initial ANN retrieval set, ideal for legal, medical, and compliance research. - Use Case: Your semantic search returns mediocre results and reranking 25 documents per query is too costly. Use this Skill to calibrate RF weights, then score only 5 seeds per query while matching reranking quality at the top of the ranking. ## Quick Start Help me set up Qdrant's Relevance Feedback API to improve my dense vector search relevance as a cheaper alternative to reranking.

Frequently Asked Questions about qdrant-relevance-feedback

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I use Qdrant's Relevance Feedback API to improve search relevance?

First train the RF formula weights using the qdrant-relevance-feedback Python library on 50-200 representative queries. Then at inference, call the Query Points API with a RelevanceFeedbackQuery containing your target vector, scored seed documents, and the calibrated naive strategy parameters.

Relevance feedback vs reranking: which should I use for vector search?

Reranking only reorders documents already retrieved, while relevance feedback modifies the vector search itself to surface documents outside the initial ANN pool. RF with 5 seeds can match reranking quality at top-1/top-3 at roughly one-fifth the scoring cost, but performs worse at deeper cutoffs.

How many feedback seed documents does Qdrant relevance feedback need?

Use at least 2 seeds, since a single seed provides no contrastive signal for the formula to establish direction. Five seeds is the recommended default; using significantly more adds noise and scoring cost without meaningful quality gains.

Can I use relevance feedback with sparse vectors in Qdrant?

No, the Relevance Feedback API does not work on sparse vectors. It operates in the dense retriever's vector space, combining similarity to the query with similarity to highly rated seeds and dissimilarity to poorly rated ones.

Why do I need to train weights before using relevance feedback?

The naive strategy weights (a, b, c) are calibrated to your specific dataset, embedding model, and feedback model's score distribution. Untrained or arbitrary weights produce random results that do not align with your data, so calibration via the train method is mandatory.

Can I switch feedback models after training relevance feedback weights?

No, the learned weights are tied to the feedback model's score scale and distribution used during calibration. If you switch feedback models, you must retrain the formula weights, and the same model must be used consistently for training and inference.