skill-evaluator

Validate Claude Code skill metadata, structure, and content via deterministic rubric.

3|Updated Apr 1, 2026
One-click install
npx skills add https://github.com/anthril/official-claude-plugins --skill skill-evaluator-anthril
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: skill-evaluator
Source: https://github.com/anthril/official-claude-plugins/tree/main/plugins/skillops/skills/skill-evaluator
Command: npx skills add https://github.com/anthril/official-claude-plugins --skill skill-evaluator-anthril

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

A tool to automatically audit Claude Code skills for metadata quality, scope, structure, and content, surfacing actionable findings and consistent reports.

Core Features & Use Cases

  • Validate required frontmatter fields (name, description, argument-hint, allowed-tools, effort) and the skill file structure
  • Enumerate and analyze SKILL.md, reference.md, templates, and example documents to surface quality signals
  • Produce a deterministic Markdown findings report plus a JSON sidecar and a concise chat-ready summary for CI and reviews

Quick Start

Run the evaluator against a target skill directory to produce a Markdown findings report and a JSON sidecar.

Frequently Asked Questions about skill-evaluator

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I audit Claude Code skills for metadata and structure quality?

You can audit Claude Code skills by validating frontmatter fields, checking required files like SKILL.md, and evaluating content against a deterministic rubric across 8 quality dimensions to generate actionable findings.

What is a deterministic rubric for skill evaluation?

A deterministic rubric for skill evaluation applies fixed criteria across 8 quality dimensions to validate metadata, structure, and content, ensuring consistent and repeatable quality audits for Claude Code skills.

How do I validate frontmatter fields in Claude Code skills?

Validating frontmatter fields in Claude Code skills involves checking for required metadata keys including name, description, argument-hint, allowed-tools, and effort, automatically identifying missing or invalid entries in the skill files.

Can I generate a markdown report and JSON sidecar for skill quality audits?

Yes, you can generate a markdown findings report and a JSON sidecar for skill quality audits, providing a prioritised fixes list and a concise chat-ready summary suitable for CI pipelines and code reviews.

Does the skill evaluation audit modify the source skill files?

No, the skill evaluation audit keeps outputs read-only to the source skill, ensuring the original skill files within plugins/*/skills directories remain unmodified during the quality validation process.

What is fast mode in skill quality audits?

Fast mode in skill quality audits is an optional setting that skips qualitative review to accelerate the validation process, focusing only on deterministic checks for metadata, structure, and required files.