guarding-test-quality

Name: guarding-test-quality
Availability: InStock
Author: rocky2431

Detect fake tests and calculate Test Authenticity Score (TAS) for test files.

11|4|Updated Oct 28, 2025

Search Tags:#static analysis #test quality #quality gates #TAS score #fake test detection

Ready to run

npx skills add https://github.com/rocky2431/ultra-builder-pro --skill guarding-test-quality

💬 Prompt for ChatGPT / Claude Chat▼

Please help me install this Agent Skill.
Skill: guarding-test-quality
Source: https://github.com/rocky2431/ultra-builder-pro/tree/main/skills/guarding-test-quality
Command: npx skills add https://github.com/rocky2431/ultra-builder-pro --skill guarding-test-quality

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill protects you from deceptive test coverage by detecting useless tests that achieve numbers without testing actual behavior.

Core Features & Use Cases

Test Authenticity Score: Calculates TAS to measure test meaningfulness beyond simple coverage percentages.

Quick Start

When running /ultra-test or editing test files, this Skill automatically analyzes test quality and blocks completion if tests don't meet quality standards.

Core Features & Use Cases

Anti-Pattern Detection: Identifies tautology tests, empty tests, and over-mocking patterns.

Quick Start

This Skill activates during testing to calculate TAS scores and enforce a minimum 70% threshold for task completion.

Frequently Asked Questions about guarding-test-quality

High-intent search queries and answers about installing and using this skill.

FAQPage Schema

How do I detect fake tests and ensure real test quality?▼

Fake test detection identifies tests that don't validate actual behavior—tautologies, empty tests, and over-mocked patterns. This Skill automatically analyzes test authenticity during /ultra-test runs and test file edits, calculating a Test Authenticity Score (TAS) to measure meaningful coverage beyond line percentages, blocking task completion if quality falls below 70%.

What is a TAS score and how is it calculated?▼

Test Authenticity Score (TAS) measures test meaningfulness using weighted components: mock ratio (25%), assertion quality (35%), real execution (25%), and anti-pattern detection (15%). A minimum TAS of 70% is required to pass quality gates; scores below this threshold block task completion.

When does test quality analysis run automatically?▼

Test quality analysis triggers during /ultra-test runs, when test files (*.test.ts, *.spec.ts, *.test.js, *.spec.js) are edited, when tasks are marked complete with tests, and on keyword-driven triggers like 'test quality', 'TAS score', 'mock ratio', 'fake tests', or 'assertion count'.

What anti-patterns does this Skill detect in tests?▼

Anti-pattern detection identifies tautology tests (assertions that always pass), empty tests (no real assertions), and over-mocking patterns that simulate behavior without testing actual code execution. Critical anti-patterns block task completion regardless of overall TAS score.

Can I use this Skill with existing test frameworks and TypeScript/JavaScript projects?▼

Yes. This Skill integrates directly with your test files during /ultra-test runs and test file edits across TypeScript and JavaScript projects (.test.ts, .spec.ts, .test.js, .spec.js files), requiring no additional setup or dependencies.