cli-qa

What problem does it solve?

This Skill helps you verify that a CLI tool behaves exactly as specified by capturing stdout, stderr, and exit codes and comparing them against a golden expectation with volatile-field redaction.

Core Features & Use Cases

• Deterministic command execution: Builds and runs the correct binary from the worktree to ensure the evidence reflects the code under test.
• Three-channel evidence capture: Records stdout, stderr, and exit code separately to preserve what the spec can assert.
• Golden-file comparisons with redaction: Compares observed output to fixtures after normalizing timestamps, PIDs, temp paths, ANSI escapes, and other volatile fields.
• QA workflows for changed surfaces: Uses diffs/logs to infer which subcommands, flags, or output formats are likely impacted when no scope is provided.
• Operational rigor: Covers environment levers for reproducibility, PTY vs non-TTY divergence, and signal-handling assertions for deterministic shutdown behavior.

Quick Start

Run the CLI with representative inputs, capture stdout/stderr/exit into a timestamped .agent-history/oracle/<card-id>/... folder, redact volatile fields, and diff the redacted stdout against the corresponding golden fixture.