cross-run-consistency

Community

Detect cross-run non-determinism in tests.

Authormytechsonamy
Version1.0.0
Installs0

System Documentation

What problem does it solve?

Runs the same test N times in one session, diffs the outputs, and classifies non-determinism by root cause. Complements observability's historical flake tracking with an immediate "does this test agree with itself right now?" answer. Gate contract — P0 scenarios must be strict-consistent (same output on N/N runs), no tolerance fuzzing, no silent averaging. PIPELINE-5 step 3.

Core Features & Use Cases

  • Cross-run reproducibility: run the critical tests multiple times and compare outputs in a single session.
  • Determinism classification: categorize differences by root cause using a predefined taxonomy.
  • On-demand gate checks: perform cross-run checks before releases and during regression-workflows.

Quick Start

Execute the cross-run consistency command with a scenario glob and optional --runs and --mode flags to begin the session.

Dependency Matrix

Required Modules

None required

Components

Standard package

💻 Claude Code Installation

Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.

Please help me install this Skill:
Name: cross-run-consistency
Download link: https://github.com/mytechsonamy/VibeFlow/archive/main.zip#cross-run-consistency

Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
View Source Repository

Agent Skills Search Helper

Install a tiny helper to your Agent, search and equip skill from 471,000+ vetted skills library on demand.