evaluate

Automates three-stage verification of execution sessions with mechanical, semantic and optional multi-model consensus checks.

5.4k|535|Updated Jan 14, 2026
One-click install
npx skills add https://github.com/Q00/ouroboros --skill evaluate-q00
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: evaluate
Source: https://github.com/Q00/ouroboros/tree/main/skills/evaluate
Command: npx skills add https://github.com/Q00/ouroboros --skill evaluate-q00

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Automates the evaluation of execution sessions using a rigorous, multi-stage verification pipeline to detect issues early and provide actionable feedback.

Core Features & Use Cases

  • Stage 1: Mechanical Verification (lint, build validation, tests, static analysis) to catch obvious defects at zero or low cost.
  • Stage 2: Semantic Evaluation (compliance scoring, goal alignment, drift measurement) to ensure the outcome matches the seed and requirements.
  • Stage 3: Multi-Model Consensus (optional) where multiple models vote on approval to handle uncertainty.
  • Use Case: Validate a new execution session before deployment, ensuring reliability and traceable quality gates.

Quick Start

Invoke the /ouroboros:evaluate command with a session_id to perform the three-stage verification.

Frequently Asked Questions about evaluate

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
What is multi-stage verification for automated execution sessions?

Multi-stage verification for execution sessions is an automated pipeline that runs mechanical lint checks, semantic compliance scoring, and multi-model consensus voting to detect defects and produce structured pass or fail reports.

How do I automate end-to-end evaluation of an execution session?

To automate evaluation of an execution session, invoke the /ouroboros:evaluate command with a valid session_id to trigger a three-stage pipeline that loads MCP tools, collects seed content, and returns actionable next steps.

Do I need MCP tools to run semantic evaluation and mechanical verification?

Yes, MCP tools are required as the evaluation pipeline explicitly loads them during the session to gather seed content and artifacts needed for both mechanical verification and semantic goal alignment scoring.

What's the best way to validate execution outcomes against requirements and trace drift?

The best way to trace drift is semantic evaluation, which measures goal alignment and compliance scoring against seed requirements during the second stage of the verification pipeline to ensure outcomes match expectations.

When should I use multi-model consensus voting for QA verification?

Multi-model consensus voting in QA verification is optional and should be used during the third stage to handle uncertainty when mechanical and semantic evaluations yield ambiguous pass or fail results across varied contexts.

Why does static analysis and lint validation run before compliance scoring in automated QA?

Static analysis and lint validation run first in automated QA to catch obvious mechanical defects at zero or low cost before the more resource-intensive semantic evaluation measures goal alignment and drift.