skill-judge

Evaluate SKILL.md files against official specifications using eight dimensions.

3|Updated Jun 23, 2022

Search Tags:#calibration #frontmatter #skill-evaluation #quality-assessment #documentation-audit #evaluation-dimensions #skill-report

Ready to run

npx skills add https://github.com/fbosch/dotfiles --skill skill-judge-fbosch

💬 Prompt for ChatGPT / Claude Chat▼

Please help me install this Agent Skill.
Skill: skill-judge
Source: https://github.com/fbosch/dotfiles/tree/main/.agents/skills/skill-judge
Command: npx skills add https://github.com/fbosch/dotfiles --skill skill-judge-fbosch

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill provides a rigorous framework to evaluate Agent Skills (SKILL.md) and Skill packages against official specifications, enabling consistent quality scoring and actionable improvements.

Core Features & Use Cases

Defines evaluation dimensions (D1-D8) including Knowledge Delta, Mindset, Anti-Pattern Quality, Specification Compliance, Progressive Disclosure, Freedom Calibration, Pattern Recognition, and Practical Usability.
Provides a structured scoring protocol, a detailed evaluation workflow, and a standardized Skill Evaluation Report template.
Useful for audits, calibration, and improvement of Skills across projects to ensure consistent activation and performance.

Quick Start

Run a Skill Evaluation Report on the target SKILL.md to generate dimension scores and a structured improvement plan.

Frequently Asked Questions about skill-judge

High-intent search queries and answers about installing and using this skill.

FAQPage Schema

How do I audit a SKILL.md file for specification compliance?▼

To audit a SKILL.md file for specification compliance, run a Skill Evaluation Report. This assesses the file against official specifications across 8 evaluation dimensions to ensure robust guidance for AI agents.

What is the best way to score Agent Skills for quality and consistency?▼

Scoring Agent Skills for quality requires a structured protocol evaluating 8 dimensions, including Knowledge Delta, Mindset, and Anti-Pattern Quality. This generates a dimensional evaluation with a final score and recommended improvements.

Can I use this skill evaluation framework to calibrate skills across multiple projects?▼

Yes, you can use this skill evaluation framework to calibrate skills across multiple projects. It applies a standardized scoring protocol and report template to ensure consistent activation and performance evaluation.

What evaluation dimensions are checked during a documentation audit?▼

A documentation audit checks 8 evaluation dimensions: Knowledge Delta, Mindset, Anti-Pattern Quality, Specification Compliance, Progressive Disclosure, Freedom Calibration, Pattern Recognition, and Practical Usability.

Does skill calibration require any dependencies or specific components?▼

Skill calibration requires no external dependencies or specific components. The evaluation operates directly on your target SKILL.md files and skill packages to produce a structured improvement plan.

How do I get actionable improvements from a skill report?▼

To get actionable improvements from a skill report, the evaluation workflow outputs a structured Skill Evaluation Report. This report contains dimension scores and a recommended improvement plan based on specification compliance.