qa-tester

Execute Modular RAG QA tests and record verified results.

Updated Apr 28, 2026
One-click install
npx skills add https://github.com/yao9906/visrag --skill qa-tester-yao9906
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: qa-tester
Source: https://github.com/yao9906/visrag/tree/main/.claude/skills/qa-tester
Command: npx skills add https://github.com/yao9906/visrag --skill qa-tester-yao9906

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires pyyaml, and includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill removes the manual burden of running a full QA sweep for the Modular RAG MCP Server by coordinating test selection, environment setup, execution, verification, and result recording end to end.

Core Features & Use Cases

It reads the test plan and progress log, executes tests in strict order, and records concrete evidence for each pass or failure. It covers CLI validation, Streamlit Dashboard checks, MCP protocol interactions, provider switching, configuration fault tolerance, and data lifecycle scenarios. It is useful when you need a reproducible regression run, a targeted section test, or an automated fix-and-retest loop for failing cases.

Quick Start

Ask the qa-tester skill to run the next QA test, a specific section, or the full test plan, and it will execute the checks and update QA_TEST_PROGRESS.md automatically.

Frequently Asked Questions about qa-tester

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I automate regression testing for a Streamlit dashboard and CLI commands?

Automate regression testing by executing the Modular RAG QA test plan, which coordinates strict serial execution and records concrete output evidence for CLI commands and Streamlit dashboard validation automatically.

What is autonomous QA testing for MCP protocol sessions?

Autonomous QA testing for MCP protocol sessions executes test plans sequentially, validates provider switching, and records verified results with concrete output evidence and progress log bookkeeping.

Can I run a targeted section test instead of a full QA sweep for failing cases?

Yes, you can run a targeted section test or an automated fix-and-retest loop for failing cases, selecting specific tests while maintaining controlled state setup and retry-aware failure handling.

How does retry-aware failure handling work during end-to-end data lifecycle scenarios?

Retry-aware failure handling records verified results and progress log bookkeeping during end-to-end data lifecycle scenarios, ensuring controlled state setup and concrete output evidence for each pass or failure.

Do I need pyyaml to run configuration fault tolerance checks?

Yes, pyyaml is required as a dependency to run configuration fault tolerance checks and execute the Modular RAG QA test plan for provider switching and data lifecycle scenarios.

Why does strict serial execution matter for QA test plan verification?

Strict serial execution ensures tests run in order with controlled state setup, preventing race conditions and ensuring concrete output evidence is accurately recorded for each pass or failure.