bmad-testarch-test-review

Reviews test files against a quality rubric and produces a scored report with actionable findings.

Updated Sep 3, 2026
One-click install
npx skills add https://github.com/watchthelight/shatterfish --skill bmad-testarch-test-review-watchthelight
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: bmad-testarch-test-review
Source: https://github.com/watchthelight/shatterfish/tree/main/.claude/skills/bmad-testarch-test-review
Command: npx skills add https://github.com/watchthelight/shatterfish --skill bmad-testarch-test-review-watchthelight

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve? Test suites often contain hidden quality problems such as hard waits, missing assertions, shared state, and flakiness patterns that pass CI but erode reliability. This Skill audits existing test files against a fixed criteria registry and produces a deterministic 0-100 quality score with severity-classified findings and concrete fixes. ## Core Features & Use Cases - Rubric-Based Test Audit: Evaluates test files against a criteria registry covering disabled tests, tautological assertions, hard waits, determinism, isolation, fixtures, data factories, and network-first patterns, with severities read from the registry rather than judged ad hoc. - Scored Review Report: Generates a structured Markdown report with a quality score, letter grade, computed recommendation (Approve, Request Changes, or Block), critical issues with file:line locations, and code examples for each fix. - Framework-Aware Analysis: Adapts to Playwright, Jest, Cypress, Vitest, Pact contract tests, and Maestro mobile flows, loading only the knowledge fragments relevant to the detected stack. - Use Case: Before merging a pull request, run the review on the changed test files to catch a committed test.only, an unawaited promise, or a race-prone navigation without an intercept, and receive a report the team can act on. ## Quick Start Ask the agent to review the test quality of the files in your tests directory and generate a scored review report.

Frequently Asked Questions about bmad-testarch-test-review

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I review test quality in my project?

Point the workflow at a single test file, a directory, or the full suite via the review_scope variable, or pass an explicit comma-separated review_files list. It loads the relevant knowledge fragments, evaluates each file against the criteria registry, and writes a scored report.

What test frameworks does this test review support?

It supports Playwright, Jest, Cypress, Vitest, Pact contract tests, and Maestro mobile flows. The stack is auto-detected from project files, and framework-specific knowledge fragments are loaded only when relevant.

How is the test quality score calculated?

The score starts at 100 and deducts 10 per critical violation, 5 per high, 2 per medium, and 1 per low, with up to 30 bonus points for patterns like comprehensive fixtures and network-first usage. Grades map from A (90-100) to F (below 60).

Does the test review check code coverage?

No, coverage analysis is explicitly out of scope. The review audits test quality only; coverage metrics and coverage gate decisions are routed to the separate trace workflow.

Can the review run without user interaction in CI?

Yes, setting headless to true skips the greeting and interactive menu, executes the create flow directly, and never prompts. Inputs such as review_files, context_files, and output_file_override are resolved from configuration.

Will the review modify my test files?

By default no; the run is report-only. Only when generate_inline_comments is set to true does it add // TODO (TEA Review) comments at violation locations without changing test logic.