test-review

Analyze Python test suites for mutation-kill value and coverage gaps.

317|40|Updated Jan 21, 2025
One-click install
npx skills add https://github.com/benchflow-ai/benchflow --skill test-review-benchflow-ai
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: test-review
Source: https://github.com/benchflow-ai/benchflow/tree/main/.agents/skills/test-review
Command: npx skills add https://github.com/benchflow-ai/benchflow --skill test-review-benchflow-ai

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill addresses the accumulation of low-value, redundant, or misleading tests that slow down development and obscure genuine regressions.

Core Features & Use Cases

  • Mutation-Kill Analysis: Evaluates tests based on their ability to catch actual code mutations rather than just asserting on mock return values.
  • Bloat Reduction: Identifies and suggests removal of mock-echo tests, unreachable defensive checks, and redundant setter/getter tests.
  • Coverage Gap Detection: Highlights missing tests for complex public functions, concurrency branches, and boundary conditions.
  • Use Case: Use this to clean up a legacy test suite where developers are afraid to delete tests, ensuring that every remaining test provides meaningful protection against real-world bugs.

Quick Start

Invoke the test-review skill to analyze the entire tests directory for bloat and coverage gaps using parallel subagents.

Frequently Asked Questions about test-review

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I identify redundant tests and coverage gaps in a Python test suite?

To identify redundant tests and coverage gaps in a Python test suite, analyze mutation-kill value by evaluating assertion logic against defined mutation rules. This detects redundant mock-echo tests and highlights missing branch coverage.

What is mutation testing and how does it evaluate test suite quality?

Mutation testing evaluates test suite quality by systematically introducing code mutations to verify if existing assertions catch the changes. It measures true mutation-kill value rather than simple mock return values, ensuring tests protect against genuine regressions.

How do I clean up a legacy pytest suite without risking hidden regressions?

Clean up a legacy pytest suite by applying mutation-kill analysis to identify bloat and coverage gaps. This systematically evaluates mock seams and assertion logic, safely detecting unreachable defensive checks and redundant setter tests while preserving high-integrity coverage.

Does this test suite refactoring approach work for Python projects using pytest?

Yes, this test suite refactoring approach applies specifically to Python-based software engineering projects using pytest. It systematically evaluates mock seams, branch coverage, and assertion logic to maintain high-integrity test maintenance during refactoring.

When should I use mutation-kill analysis instead of standard code coverage?

Use mutation-kill analysis instead of standard code coverage when you need to prune bloat from accumulated low-value tests. It identifies misleading tests that assert only on mock return values, ensuring remaining tests provide meaningful protection against real-world bugs.