evaluate

Record agent task outcomes and evidence into an append-only effectiveness.jsonl log.

Updated Apr 27, 2026
One-click install
npx skills add https://github.com/vTRKA/supervibe --skill evaluate-vtrka
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: evaluate
Source: https://github.com/vTRKA/supervibe/tree/main/skills/evaluate
Command: npx skills add https://github.com/vTRKA/supervibe --skill evaluate-vtrka

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

It prevents AI coding sessions from becoming subjective by turning each agent’s claimed completion into an evidence-backed evaluation record you can review later.

Core Features & Use Cases

  • Evidence-based effectiveness logging: Records outcome, iterations, blockers, confidence, and user corrections into effectiveness.jsonl.
  • Rubric-driven confidence evaluation: Selects the correct confidence rubric from declared rubric sources or artifact type mapping.
  • Verification-gated scoring: Classifies success/partial/failed based on required verification, confidence thresholds, and receipt/evidence presence.

Quick Start

Ask your AI to evaluate the most recent completed task by appending an effectiveness entry for the agent output and evidence packet.

Frequently Asked Questions about evaluate

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I log agent delivery outcomes with evidence for AI coding sessions?

Agent delivery outcomes are logged with evidence by recording task iterations, blockers, and confidence scores into an append-only effectiveness.jsonl file, preventing subjective claims by turning outputs into reviewable records.

How does rubric-driven confidence scoring work for code delivery verification?

Rubric-driven confidence scoring evaluates code delivery by selecting the correct confidence rubric from declared sources or artifact type mapping, then classifying the outcome as success, partial, or failed based on thresholds.

What is needed to construct an evidence packet for agent evaluation?

Constructing an evidence packet for agent evaluation requires gathering the task request, produced artifacts, workflow receipts, verification outputs, and context evidence to generate a classification with a gate status.

When should I evaluate agent effectiveness and append corrections to the log?

Agent effectiveness evaluation should be applied after each agent task completion or after user corrections, capturing rubric-based assessment for produced artifacts and verification evidence into the append-only log.

Does verification-gated scoring require receipts for confidence threshold classification?

Verification-gated scoring requires receipt and evidence presence to classify success, partial, or failed outcomes, ensuring confidence thresholds are met before the agent output is validated.