qa-tester

Automate end-to-end QA testing for the Modular RAG MCP Server.

21|2|Updated May 19, 2026
One-click install
npx skills add https://github.com/wutongyuonce/MODULAR-RAG-MCP --skill qa-tester-wutongyuonce
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: qa-tester
Source: https://github.com/wutongyuonce/MODULAR-RAG-MCP/tree/main/.claude/skills/qa-tester
Command: npx skills add https://github.com/wutongyuonce/MODULAR-RAG-MCP --skill qa-tester-wutongyuonce

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires PyYAML, and includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill provides fully autonomous QA testing for the Modular RAG MCP Server, eliminating manual QA work and ensuring regression coverage across CLI, the Streamlit dashboard, MCP protocol interactions, and data lifecycle workflows.

Core Features & Use Cases

  • Reads QA_TEST_PLAN.md and executes all test types automatically, including CLI commands, headless dashboard validation, MCP protocol interactions, and provider switches.
  • Diagnoses failures, applies fixes with up to three retry rounds, and records results in QA_TEST_PROGRESS.md for traceability.
  • Supports running tests via prompts like run QA, QA test, or test scripts, enabling repeatable, end-to-end validation in CI or local environments.

Quick Start

Run a complete QA pass against the Modular RAG MCP Server with a single command.

Frequently Asked Questions about qa-tester

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I automate end-to-end QA testing for a Modular RAG MCP server?

End-to-end QA testing for a Modular RAG MCP server is automated by reading QA_TEST_PLAN.md to orchestrate CLI commands, Streamlit dashboard validation, and MCP protocol interactions with serial execution and retry logic.

What do I need to run automated QA tests for MCP protocol interactions and CLI commands?

To run automated QA tests, you need QA_TEST_PLAN.md as the test source and QA_TEST_PROGRESS.md for logging results. The environment must support PyYAML to execute the provided test scripts.

Can I use automated QA testing to validate a Streamlit dashboard and data lifecycle workflows?

Automated QA testing can validate a Streamlit dashboard and data lifecycle workflows by applying headless dashboard validation and executing ingest, query, and evaluation scripts in either CI or local environments.

How does automated QA testing handle test failures during a CLI and MCP protocol validation run?

Automated QA testing handles failures by diagnosing errors, applying fixes automatically, and running up to three retry rounds. All outcomes and traces are recorded in QA_TEST_PROGRESS.md for full traceability.

What is the best way to trigger a full QA test pass for a RAG MCP server in a CI environment?

The best way to trigger a full QA test pass in a CI environment is using prompts like run QA, QA test, or test scripts. This executes all test types defined in QA_TEST_PLAN.md automatically.