Capture stdout, stderr, and exit codes for CLI golden-file QA.
npx skills add https://github.com/kylesnowschwartz/ralph-ban --skill cli-qa
Please help me install this Agent Skill. Skill: cli-qa Source: https://github.com/kylesnowschwartz/ralph-ban/tree/main/skills/cli-qa Command: npx skills add https://github.com/kylesnowschwartz/ralph-ban --skill cli-qa
This Skill helps you verify that a CLI tool behaves exactly as specified by capturing stdout, stderr, and exit codes and comparing them against a golden expectation with volatile-field redaction.
Run the CLI with representative inputs, capture stdout/stderr/exit into a timestamped .agent-history/oracle/<card-id>/... folder, redact volatile fields, and diff the redacted stdout against the corresponding golden fixture.
High-intent search queries and answers about installing and using this skill.
Verifying CLI behavior requires driving a command-line binary with representative inputs, capturing stdout, stderr, and exit codes separately, and comparing them against expected output with volatile fields redacted. This ensures deterministic transcripts for end-to-end QA.
Redacting volatile fields normalizes timestamps, PIDs, temp paths, and ANSI escapes before comparing observed output to golden fixtures. This byte-exact redaction scheme ensures deterministic comparisons even when the underlying runtime values change between executions.
Testing CLI error handling and exit-code semantics involves capturing the exit code immediately after execution and recording stderr separately from stdout. This three-channel evidence capture preserves what the specification can assert during end-to-end QA.
Golden-file comparisons support testing large or structurally rich CLI outputs by diffing redacted stdout against expected fixtures. This approach applies to QA workflows for subcommands, flags, and output formats without requiring manual output inspection.
CLI testing covers operational rigor including PTY vs non-TTY divergence and signal-handling assertions for deterministic shutdown behavior. Normalizing environment variables ensures reproducibility across different terminal environments during command execution.
cloudfieldczRun verification commands and review output before claiming completion.
DigicationGenerate conventional commit messages from changed files and diffs.
matt-rileyRun exact verification commands and quote fresh output as evidence.
po4ykaAutomate golden fixture management for telemetry and diagnostics data.
