qa-tester

Automate QA test execution, verification, and result logging for a modular RAG application.

Updated Mar 5, 2026
One-click install
npx skills add https://github.com/ljk486/Rag-agent --skill qa-tester-ljk486
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: qa-tester
Source: https://github.com/ljk486/Rag-agent/tree/main/MODULAR-RAG-MCP-SERVER-clean-start/.claude/skills/qa-tester
Command: npx skills add https://github.com/ljk486/Rag-agent --skill qa-tester-ljk486

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires pyyaml, and includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill removes the manual effort from end-to-end QA by automatically selecting pending tests, executing them in the correct order, validating outputs against expected results, and recording progress.

Core Features & Use Cases

  • Fully automated test execution: Runs CLI, dashboard UI, MCP protocol, configuration-switch, and data-lifecycle checks without human intervention.
  • Self-healing workflow: Diagnoses failures, applies minimal fixes, retries up to three rounds, and preserves a clear audit trail in QA_TEST_PROGRESS.md.
  • Strict verification discipline: Requires concrete terminal evidence for pass results and enforces section-end validation to catch weak or inferred notes.
  • Use case: When you need to run a complete QA pass for the Modular RAG MCP Server, this Skill can bootstrap state, execute the relevant test, verify the result, and update the progress log.

Quick Start

Ask the qa-tester skill to run the next pending QA test and update QA_TEST_PROGRESS.md with the verified result.

Frequently Asked Questions about qa-tester

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I automate QA test execution for a RAG application with CLI and MCP protocol calls?

Automating QA test execution involves selecting pending tests, running CLI and MCP protocol calls in order, and validating outputs against expected results. This Skill automates that entire workflow, including configuration profile switching and result logging.

How does automated QA testing handle failures and retries for Streamlit dashboard checks?

Automated QA testing handles failures by diagnosing errors, applying minimal fixes, and retrying up to three rounds. It preserves a clear audit trail in QA_TEST_PROGRESS.md to ensure Streamlit dashboard checks pass based on concrete terminal evidence.

Do I need YAML configuration files to run end-to-end data lifecycle tests?

Yes, YAML configuration editing is required for end-to-end data lifecycle tests. The testing process depends on deterministic subprocess control and YAML configuration profiles to switch contexts and validate multi-step data lifecycle scenarios accurately.

What is the best way to verify QA test results without manual inspection?

The best way to verify QA test results is through strict verification discipline requiring concrete terminal evidence. This approach enforces section-end validation to catch weak or inferred notes, ensuring pass criteria are evidence-based rather than manually inspected.

Can I use this QA testing approach for multi-step data lifecycle scenarios in a Modular RAG MCP Server?

Yes, you can use this QA testing approach for multi-step data lifecycle scenarios in a Modular RAG MCP Server. It bootstraps state, executes relevant tests across CLI and dashboard interfaces, verifies results, and updates the progress log automatically.

Why does QA test automation require progress note validation during execution?

QA test automation requires progress note validation to catch weak or inferred notes during execution. It enforces section-end validation with retries, ensuring that progress logs in QA_TEST_PROGRESS.md contain verified, evidence-based pass results rather than assumptions.