RAG Quality Skill

Design, implement, and validate retrieval-augmented generation systems.

1|Updated Mar 7, 2026
One-click install
npx skills add https://github.com/jimmymalhan/codereview-pilot --skill rag-quality-skill
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: RAG Quality Skill
Source: https://github.com/jimmymalhan/codereview-pilot/tree/main/.claude/skills/rag-quality
Command: npx skills add https://github.com/jimmymalhan/codereview-pilot --skill rag-quality-skill

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

This Skill provides a comprehensive guide to building, implementing, and validating retrieval-augmented generation (RAG) systems, addressing issues like hallucinations and citation inaccuracies.

Core Features & Use Cases

  • Playbook for RAG: Offers step-by-step instructions for data preparation, indexing, search, grounding, and maintenance.
  • Quality Assurance: Defines verification steps and roles for ensuring RAG system integrity.
  • Use Case: When a user reports that your AI assistant is providing incorrect information or fabricating sources, this Skill's playbook can be used to audit and improve the RAG pipeline.

Quick Start

Use the RAG Quality Skill to review the data preparation and indexing steps for our new knowledge base.

Frequently Asked Questions about RAG Quality Skill

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I reduce hallucinations in my retrieval augmented generation system?

To reduce hallucinations in your retrieval augmented generation system, you can apply a structured playbook covering data preparation, indexing, search grounding, and citation validation. This enforces strict verification steps to ensure LLM outputs are factual.

How do I validate citations in my RAG pipeline?

Validating citations in your RAG pipeline requires defining specific quality assurance roles and verification steps to audit the grounding process. This ensures that generated responses correctly reference the retrieved source documents.

What steps are needed to build a reliable retrieval augmented generation pipeline?

Building a reliable retrieval augmented generation pipeline requires sequential steps for data preparation, indexing, search configuration, and grounding. Implementing continuous learning procedures and freshness maintenance ensures long-term system integrity.

Why does my LLM assistant fabricate sources and incorrect information?

Your LLM assistant fabricates sources and incorrect information due to inadequate retrieval grounding and missing citation validation. Auditing your RAG pipeline's data indexing and search grounding steps can identify and resolve these hallucination issues.

What is the best way to maintain data freshness in a RAG system?

The best way to maintain data freshness in a RAG system is to implement continuous improvement learning procedures within the retrieval pipeline. This involves regularly validating the indexing process and updating the knowledge base to prevent outdated responses.

Can I use this RAG quality playbook to audit an existing knowledge base?

Yes, you can use this RAG quality playbook to audit an existing knowledge base by reviewing its data preparation and indexing steps. It provides verification procedures to evaluate and improve the integrity of your current retrieval augmented generation setup.