ai-raccoon-retrieval-analysis

Analyze and improve AiRaccoon hybrid FTS5-vector retrieval quality through measured baselines.

2|Updated Aug 2, 2026
One-click install
npx skills add https://github.com/Arasz/ai-raccoon --skill ai-raccoon-retrieval-analysis-arasz
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: ai-raccoon-retrieval-analysis
Source: https://github.com/Arasz/ai-raccoon/tree/main/.ai-badger/skills/learned/uncategorized/ai-raccoon-retrieval-analysis
Command: npx skills add https://github.com/Arasz/ai-raccoon --skill ai-raccoon-retrieval-analysis-arasz

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve? Diagnosing why a hybrid search pipeline misses expected results is hard: rank changes can be measurement artifacts, stale databases, or genuine regressions. This Skill provides a verified methodology for analyzing AiRaccoon's FTS5+vec0 retrieval quality, tracing failures through the pipeline, and structuring improvements into measurable waves. ## Core Features & Use Cases - Retrieval Baseline Analysis: Read baseline reports, trace missed queries through normalization, chunking, BM25, vector ranking, and RRF fusion, then classify failures as structural, algorithmic, parametric, or measurement gaps. - A/B Comparison Methodology: Compare candidate retrieval improvements with a shared-scorer rule, pre-registered win criteria, and section-level hit metrics to avoid harness drift and test-set leakage. - Live-Bank Diagnostics: Audit a running server's memory bank with WAL-safe SQLite copies, promotion-queue SQL audits, and grading-coverage analysis. - Use Case: When a gate test fails after merging a retrieval change, use the integration rank-verification protocol to re-measure on the joined state, content-verify rank deltas against chunk contents, and distinguish same-knowledge trades from real regressions. ## Quick Start Analyze the retrieval baseline report and trace each missed query through the FTS5 and vector pipeline to classify the failure type.

Frequently Asked Questions about ai-raccoon-retrieval-analysis

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I diagnose why a hybrid search query misses its expected result?

Trace the query through each pipeline stage: FTS5 normalization, chunking, BM25 rank, vector rank, RRF fusion, and candidate window coverage. Then classify the failure as structural, algorithmic, parametric, or a measurement gap before proposing a fix.

How do I compare two retrieval improvements fairly?

Route every arm's raw ranked list through one shared scorer that computes file hit, section hit, and MRR from a single implementation. Pre-register a win rule such as two section-level hit flips or an MRR delta of 0.1, and publish per-query rank tables.

Why does FTS5 AND-based query matching return zero results?

FTS5 AND requires all tokens to co-occur inside a single chunk, but section-chunked documents spread tokens across chunks. Use OR-join or an AND-with-OR-fallback triggered when hits fall below a threshold.

Can I inspect sqlite-vec vec0 tables with the system sqlite3 CLI?

No, the stock sqlite3 CLI lacks the vec0 module and reports 'no such module: vec0'. Plain tables and FTS5 tables work in the CLI; vec0 tables must be read through the application's Microsoft.Data.Sqlite or a live server probe.

Why do test rankings differ from live server rankings on the same database?

Tests copy the corpus from the build output directory, which can be stale because PreserveNewest skips mtime-equal copies. Verify with shasum on both files, rebuild to refresh the output copy, and re-run before debugging further.

When is a rank change a real regression versus an acceptable trade?

A rank delta alone is not evidence. Read the competing chunks and check whether the new top result carries the same knowledge as the expected source; same-knowledge alternatives at rank 1 are a bounded trade, not a regression.