information-retrieval

Diagnose and fix search relevance failures in skills retrieval engines.

Updated May 28, 2026
One-click install
npx skills add https://github.com/zhang-ming-hui/ackownledge --skill information-retrieval
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: information-retrieval
Source: https://github.com/zhang-ming-hui/ackownledge/tree/main/ir_system/.agents/skills/information-retrieval
Command: npx skills add https://github.com/zhang-ming-hui/ackownledge --skill information-retrieval

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

It helps you improve weak skill search results by isolating why relevant skills are missed or ranked too low, then applying targeted fixes to tokenization, expansion, weighting, indexing, or ranking.

Core Features & Use Cases

  • Failure-bucket driven debugging: Reproduce a failing query, map the issue to a specific failure cause, and target the smallest change that improves that bucket.
  • Retrieval pipeline iteration: Tune components such as tokenization, query expansion, field weighting, and ranking so the retrieval engine matches expected skills.
  • Evaluation-driven validation: Re-run the relevant evaluation set and compare before/after metrics to avoid regressions.

Quick Start

Ask an AI to reproduce a failing query from your evaluation output, identify the most likely failure cause (tokenization gap, missing expansion, weighting issue, popularity boost dominance, or missing data), then propose the smallest configurable change in the IR code/config and re-run the affected evaluation bucket to confirm metric improvement.

Frequently Asked Questions about information-retrieval

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I debug search ranking failures when relevant results are missing or ranked too low?

To debug search ranking failures, reproduce the failing query, map the issue to a specific cause like tokenization gaps or weighting issues, and apply the smallest configurable change to the retrieval engine. Re-run the affected evaluation bucket to confirm metric improvement.

What is failure-bucket driven debugging in information retrieval?

Failure-bucket driven debugging in information retrieval isolates why relevant results are missed by classifying root causes—such as missing expansion or popularity boost dominance—into buckets. This targets the smallest change that improves the specific failing query bucket.

How can I fix weak search relevance without causing baseline regressions?

Fix weak search relevance without regressions by making minimal configurable changes to tokenization, query expansion, or indexing, then comparing before/after evaluation metrics across the relevant evaluation set.

Why does my search ranking return incorrectly ranked results for specific queries?

Incorrectly ranked search results stem from tokenization gaps, missing query expansion, field weighting issues, popularity boost dominance, or missing data. Diagnosing the specific failure bucket and tuning the retrieval pipeline resolves the ranking errors.

Does query expansion improve search ranking accuracy for weak results?

Yes, query expansion improves search ranking accuracy by broadening the query terms to match expected skills. Tuning expansion within the retrieval pipeline iteration helps correctly rank previously weak or missed results.

What is the best way to evaluate search relevance improvements after fixing tokenization?

The best way to evaluate search relevance improvements is by running evaluation-driven validation. Re-run the affected evaluation bucket and compare before/after metrics to ensure the tokenization fix works without causing baseline regressions.