speckit-bug-test

Validate that a recorded bug fix resolves the reported issue and write a verification report.

32|9|Updated Feb 2, 2024
One-click install
npx skills add https://github.com/Esri/arcgis-gitops --skill speckit-bug-test-esri
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: speckit-bug-test
Source: https://github.com/Esri/arcgis-gitops/tree/main/.github/skills/speckit-bug-test
Command: npx skills add https://github.com/Esri/arcgis-gitops --skill speckit-bug-test-esri

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve? After a bug fix is applied, teams often lack a structured way to confirm the fix actually resolves the original symptom without introducing regressions. This Skill closes that gap by re-running reproduction steps and test suites, then recording a formal verification report. ## Core Features & Use Cases - Fix Verification: Re-runs the reproduction steps from the bug assessment and the tests added by the fix to confirm the symptom is gone. - Regression Checking: Executes existing test suites, lint, and type-checks for the changed modules to detect side effects. - Structured Reporting: Writes a verification report to .specify/bugs/<slug>/test.md with a verdict of verified, partial, or failed, plus checks performed, output excerpts, and residual risks. - Use Case: After running a bug-fix workflow on a login timeout issue, invoke this Skill to re-execute the reproduction steps and test suite, producing an auditable report that decides whether to close, hold, or reopen the bug. ## Quick Start Validate the fix for the login-timeout bug and generate the verification report in its bug directory.

Frequently Asked Questions about speckit-bug-test

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I verify a bug fix in a spec-kit project?

Run the bug test workflow with the bug slug, for example by passing slug=<bug-slug> or a path like .specify/bugs/login-timeout/. It re-runs the reproduction steps and tests, then writes a verification report to .specify/bugs/<slug>/test.md.

What happens if I don't provide a bug slug?

The workflow resolves the slug from conversation context, then from a single fix.md candidate on disk. If multiple candidates exist, it asks interactively or stops with an error in automated mode rather than guessing.

What prerequisites are required before running bug verification?

Both assessment.md and fix.md must exist in the bug's directory under .specify/bugs/<slug>/. If fix.md is missing, you must run the bug fix workflow first before verification can proceed.

Does the bug test workflow modify my source code?

No. It only runs checks such as tests, lint, and type-checks, and writes the report inside .specify/bugs/<slug>/. It never edits source files and never overwrites an existing test.md without confirmation.

What do the verified, partial, and failed results mean?

Verified means all critical checks pass and the symptom no longer reproduces. Partial means the symptom is gone but regressions appeared or checks were inconclusive. Failed means the symptom still reproduces or the fix broke the regression suite.

What if a verification check cannot be run?

Checks that are destructive, network-dependent, or expensive are skipped with a recorded reason. Checks that cannot run due to missing tooling are marked not-run, and results are never fabricated.