Test Quality Audit

Detect test quality anti-patterns in modified test files and suites.

6|1|Updated Nov 12, 2025
One-click install
npx skills add https://github.com/auldsyababua/instructor-workflow --skill test-quality-audit
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: Test Quality Audit
Source: https://github.com/auldsyababua/instructor-workflow/tree/main/skills/test-quality-audit
Command: npx skills add https://github.com/auldsyababua/instructor-workflow --skill test-quality-audit

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Scan test files for anti-patterns including mesa-optimization, disabled tests, trivial assertions, and error swallowing to improve test quality.

Core Features & Use Cases

  • Identify disabled tests, trivial assertions, and error swallowing
  • Generate actionable remediation notes
  • Publish a QA validation report

Quick Start

Run the audit on a set of PR-diff modified tests:

  • python scripts/test_quality_audit.py --paths tests/ --format json

Frequently Asked Questions about Test Quality Audit

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I detect disabled tests and trivial assertions in my test suite?

Test quality audit scans test files for anti-patterns including disabled tests, trivial assertions, and error swallowing. It applies regex- and pattern-based checks to files matching *.test.js, *.spec.ts, *_test.py, and test_*.py, then classifies findings by severity and generates actionable remediation notes.

Can I audit test quality across an entire Python codebase or just modified files?

The audit runs on both PR-diff modified tests and entire test suites. You specify the target paths (e.g., tests/) and file patterns; it scans all matching files and outputs structured reports with pass criteria enforcement.

What test anti-patterns does this audit catch?

The audit detects mesa-optimization, disabled tests, trivial assertions, and error swallowing. Each anti-pattern receives severity classification and structured reporting so you can prioritize remediation across your test suite.

How do I integrate test quality checks into my PR review workflow?

Run the audit on PR-modified tests using the command-line interface with --paths and --format json flags. It generates a QA validation report with actionable findings, enforcing test quality pass criteria before merge.

Does test quality audit work with JavaScript and TypeScript test files?

Yes. The audit scans *.test.js and *.spec.ts files alongside Python patterns (*_test.py, test_*.py), applying pattern-based checks and severity classification across all supported test file formats.

What output format does the test audit provide?

The audit publishes structured JSON reports containing detected anti-patterns, severity levels, and remediation notes. Output can be consumed programmatically for CI/CD integration or parsed for human review.