eval-skeleton

Community

Generate a template for evals/scenarios/<agent>/scenario.json

Authorinfantesromeroadrian
Version1.0.0
Installs0

System Documentation

What problem does it solve?

This Skill generates a minimal template for evals/scenarios/<agent>/scenario.json by introspecting agents/<agent>.md frontmatter, phase assignment from CLAUDE.md pipeline, critic-gate exempt status, and the first distinctive keywords in the prompt body. It provides a starting point for operators to refine before running evals.

Core Features & Use Cases

  • Scenario Generation: Automatically creates a scenario.json template based on agent introspection.
  • Todo Markers: Includes TODO markers that operators must refine before running evals.
  • Collision Avoidance: Refuses to overwrite an existing scenario.json unless explicitly forced.

Quick Start

Run the command '/eval-skeleton <agent>' to generate a scenario.json template for the specified agent.

Dependency Matrix

Required Modules

jqpython

Components

scripts

💻 Claude Code Installation

Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.

Please help me install this Skill:
Name: eval-skeleton
Download link: https://github.com/infantesromeroadrian/arca-agent/archive/main.zip#eval-skeleton

Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
View Source Repository

Agent Skills Search Helper

Install a tiny helper to your Agent, search and equip skill from 620,000+ vetted skills library on demand.