adversarial-documentation-driven-testing

Build documentation-traceable test coverage with adversarial loops that expose weak tests and API drift.

Updated May 4, 2026
One-click install
npx skills add https://github.com/cwortman-amd/webtools-ui --skill adversarial-documentation-driven-testing-cwortman-amd
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: adversarial-documentation-driven-testing
Source: https://github.com/cwortman-amd/webtools-ui/tree/main/skills/adversarial-documentation-driven-testing
Command: npx skills add https://github.com/cwortman-amd/webtools-ui --skill adversarial-documentation-driven-testing-cwortman-amd

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve? Test suites often show high line coverage while missing broken frontend-backend linkage, undocumented features, API contract drift, and stale documentation claims. This Skill establishes a verifiable chain from every documented capability through implementation, backend effect, and automated tests, so coverage claims rest on evidence rather than inference. ## Core Features & Use Cases - Traceability Matrix: Maps each documentation claim to frontend controls, backend contracts, persistence, observable results, and the tests that prove them. - Adversary Loops: Forms falsifiable hypotheses and uses fault injection, mutation testing, and schema perturbation to expose weak tests, permission bypasses, and contract drift. - CI Quality Gates: Enforces documentation traceability, workflow coverage, control linkage, contract integrity, and test health with owned, expiring exceptions. - Use Case: When asked to expand test coverage for a web app, inventory all README and API doc claims, verify every UI control actually drives backend behavior end-to-end, then add regression tests for every defect the adversary loop uncovers. ## Quick Start Audit this repository's documented features against its tests and build a traceability matrix with adversarial coverage for frontend-backend linkage.

Frequently Asked Questions about adversarial-documentation-driven-testing

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I verify frontend controls actually change backend behavior?

Trace each control through the full chain: UI action, client state, exact API request (method, route, body schema), backend processing, persisted state, and visible result. A mocked-function-called assertion is not sufficient evidence of working linkage.

What is adversarial testing for test suites?

Adversarial testing forms falsifiable hypotheses about weak tests or missing coverage, then uses fault injection, mutation testing, and schema perturbation to confirm the suite fails when behavior is intentionally broken. Each finding gets a regression test.

How do I detect documentation drift in a codebase?

Inventory every explicit claim in READMEs, PRDs, API specs, and changelogs, then map each to implementation and tests in a traceability matrix. Claims without code, code without docs, and schema mismatches surface as drift findings.

Why is high line coverage not enough for test quality?

Line coverage can hide broad mocks that accept incorrect requests, happy-path-only tests, and skipped or flaky tests. Meaningful coverage requires branch and condition tests, contract validation, and mutation testing on critical logic.

When should I not run a full adversarial testing audit?

Skip the full workflow for narrow tasks like a single isolated test fix, a wording change in a test, or cosmetic refactoring with no coverage implications. Apply only the relevant portions of the workflow instead.