aibdd-red-evaluate

Evaluate AIBDD Red Worker runs against Type A/B gates and emit PASS/FAIL reports.

77|15|Updated May 12, 2026
One-click install
npx skills add https://github.com/Waterball-Software-Academy/aixbdd --skill aibdd-red-evaluate
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: aibdd-red-evaluate
Source: https://github.com/Waterball-Software-Academy/aixbdd/tree/main/.agents/skills/aibdd-red-evaluate
Command: npx skills add https://github.com/Waterball-Software-Academy/aixbdd --skill aibdd-red-evaluate

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

It prevents downstream Green execution from consuming an invalid or misleading Red run by evaluating whether the red signals are both legal (runner correctness) and meaningful (user-observable behavior gap).

Core Features & Use Cases

  • Hard-gate validation (Type A): Detects false red caused by runner errors, invalid step definitions, missing/incorrect scenario-to-step grounding, and evidence boundary issues.
  • Hollow-red semantic detection (Type B): Flags red failures that do not establish a real user-observable behavior gap (e.g., harness/environment issues or assertions against non-public internals).
  • Evidence-driven reporting: Reads runner-native test reports, runtime-visible feature files, and runtime-visible step definition files, then emits a structured PASS/FAIL evaluation report.
  • Workflow guardrail for AIBDD: Produces a verdict that either allows Green to proceed or vetoes it when findings exist, enforcing disciplined RED → GREEN → REFACTOR flow.

Quick Start

Provide the Red handoff payload (or explicit artifact pointers) including the target feature files, runner-native test report path, runtime feature/step roots, and the step-definition files touched, then run this skill to output a PASS/FAIL red evaluation report.

Frequently Asked Questions about aibdd-red-evaluate

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I validate if a failing BDD test report represents a real behavior gap?

To validate a failing BDD test report, you evaluate the runner-native evidence against feature files and step definitions to distinguish a legal, meaningful red failure from a false-red environment issue or a hollow-red non-behavior gap. This prevents downstream execution from consuming invalid signals.

What is a false red in BDD workflow orchestration?

A false red in BDD workflow orchestration occurs when test failures stem from runner errors, invalid step definitions, or environment issues rather than a genuine user-observable behavior gap. It is detected by enforcing hard gates on runner-native test report evidence before proceeding.

How do I stop Green execution when Red acceptance testing is invalid?

You stop Green execution by applying an evaluation gate to the Red handoff payload, which reads test reports and step definitions to emit a FAIL verdict with veto-level findings if false-red or hollow-red conditions are detected. This blocks the RED → GREEN flow.

When do I need to evaluate step definitions before proceeding to Green?

You need to evaluate step definitions before proceeding to Green when a Red Worker run completes, ensuring the failing evidence is legally grounded in valid scenario-to-step mappings and establishes a real behavior gap. This evaluation outputs a PASS/FAIL report.

Can I use test report analysis to detect hollow-red non-behavior failures?

Yes, you can use test report analysis to detect hollow-red non-behavior failures by applying semantic detection gates that flag assertions against non-public internals or harness issues. This ensures the red failure establishes a real user-observable behavior gap.

What are the limitations of automated red evaluation in AIBDD workflows?

Automated red evaluation is limited to reading only allowed evidence boundaries within runner-native test reports and runtime-visible files, meaning it cannot assess external state or ungrounded scenarios. It strictly enforces Type A and Type B hard gates based solely on visible artifacts.