agent-evaluation

Audit Claude Code agents and skills with a 6-step rubric.

415|44|Updated Mar 18, 2026
One-click install
npx skills add https://github.com/notque/claude-code-toolkit --skill agent-evaluation-notque
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: agent-evaluation
Source: https://github.com/notque/claude-code-toolkit/tree/main/skills/agent-evaluation
Command: npx skills add https://github.com/notque/claude-code-toolkit --skill agent-evaluation-notque

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) components.

What problem does it solve?

Audits Claude Code agents and skills for quality, completeness, and standards compliance using a consistent 6-step rubric.

Core Features & Use Cases

  • Objective scoring of agents and skills against a 100-point rubric
  • Structural and content validation including YAML front matter, Operator Context, error handling, references, and anti-pattern checks
  • Comprehensive reporting with prioritized findings and recommended improvements for collections or individual items
  • Use Case: when auditing newly created or updated agents/skills, or when assessing collection health

Quick Start

Run the evaluation workflow to audit all agents and skills and generate a results report.

Frequently Asked Questions about agent-evaluation

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I evaluate the quality of AI agents and skills?

Evaluating AI agent and skill quality involves applying a standardized 6-step rubric to score structure, content, and integration gaps. This process audits items against a 100-point scale to surface missing YAML front matter, Operator Context, or error handling.

What is a rubric-based audit for Claude Code agents?

A rubric-based audit is a standardized evaluation process that checks Claude Code agents and skills for completeness and standards compliance. It applies a 6-step rubric to identify structural and content gaps, producing traceable results with file paths and line references.

How do I audit a collection of agents for missing error handling?

Auditing a collection of agents for missing error handling requires running a standardized evaluation workflow. The rubric checks for anti-patterns, validates references, and outputs a structured report with prioritized findings and recommended improvements.

Can I score individual agents against a 100-point quality standard?

Yes, you can score individual agents against a 100-point quality standard by applying the evaluation rubric. The audit objectively scores the agent's YAML front matter, Operator Context, and error handling to identify specific quality gaps.

What does a structured agent evaluation report include?

A structured agent evaluation report includes prioritized findings, recommended improvements, and traceable results with specific file paths and line references. It documents quality gaps found across the collection or individual items during the rubric assessment.

When do I need to run an agent quality assessment?

You need to run an agent quality assessment when auditing newly created or updated agents and skills, or when assessing the overall health of your collection. The evaluation ensures your agents meet structural and content standards before deployment.