eval-agents

Evaluate AGENTS.md context sufficiency by spawning subagents across scenario groups.

1|2|Updated Jan 16, 2026
One-click install
npx skills add https://github.com/lepahc/kynetic-spec --skill eval-agents-lepahc
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: eval-agents
Source: https://github.com/lepahc/kynetic-spec/tree/main/.agents/skills/eval-agents
Command: npx skills add https://github.com/lepahc/kynetic-spec --skill eval-agents-lepahc

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

AGENTS.md is loaded into every agent's context. This skill validates that the documentation provides enough context for agents to make correct decisions and guides how to test and improve it.

Core Features & Use Cases

  • Validates AGENTS.md completeness and accuracy to ensure agents have the necessary context and guardrails.
  • Orchestrates evaluation by spawning subagents across scenario groups and grading responses.
  • Useful after edits to AGENTS.md, adding/removing skills, or changing core workflows to maintain alignment.

Quick Start

Spawn evaluation agents to test AGENTS.md and adjust documentation based on results.

Frequently Asked Questions about eval-agents

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I test if my AGENTS.md provides enough context for agent decisions?

To test AGENTS.md completeness, spawn scenario-based evaluation subagents that grade agent responses against expected behaviors. This quantifies whether the documentation provides sufficient guardrails and context for reliable agent decisions.

What is scenario-based evaluation for agent documentation?

Scenario-based evaluation for agent documentation is a testing framework that spawns subagents across scenario groups to grade responses and validate contextual guidance. It ensures documentation meets criteria for reliable agent decisions and health checks.

When should I evaluate AGENTS.md documentation for agent guidance?

Evaluate AGENTS.md documentation after editing the file, adding or removing skills, or changing core workflows. This maintains alignment and ensures agents receive complete contextual guidance for their operational tasks.

How do I validate AGENTS.md completeness after changing core workflows?

Validate AGENTS.md completeness after changing core workflows by spawning evaluation agents across scenario groups to grade responses. This framework checks if updated documentation provides enough context for capable agent behavior and health checks.

Does scenario-based agent testing work without external dependencies?

Scenario-based agent testing works without external dependencies by using internal spawn logic to orchestrate subagents. The evaluation framework grades responses autonomously to quantify AGENTS.md contextual completeness and validate guidance criteria.