vibe-test-runner

What problem does it solve?

Ensures code changes to shell scripts and critical CLI tools are safe, correct, and conformant by running a four-layer validation pipeline that produces machine-readable evidence and attempts automated fixes up to three rounds before requiring human intervention.

Core Features & Use Cases

• Serena Impact Analysis: Runs change impact discovery and emits .agent/reports/serena-impact.json to ensure call-site consistency when modifying functions or signatures.
• Lint & Syntax Checks: Performs zsh syntax checks and ShellCheck error-level linting and auto-fixes issues when possible.
• Test Execution and Repair Loop: Runs bats test suites, analyzes failures, attempts fixes, and repeats up to three rounds shared across lint and tests.
• Strict Review Gate: Produces a reviewer-style outcome (Blocking/Major/Minor/Nit) with file/function, failure mode, and minimal fix suggestions.
• Use Case: Pre-PR verification for changes to lib/*.sh or bin/vibe, CI orchestration premerge gates, and instrumented execution by the Vibe Orchestrator.

Quick Start

Run the orchestrator to execute the vibe-test-runner which performs Serena analysis, linting, tests, and a strict review gate with up to three automated repair rounds.