skill-judge

Evaluate SKILL.md files against official specifications using eight dimensions.

3|Updated Jun 23, 2022
One-click install
npx skills add https://github.com/fbosch/dotfiles --skill skill-judge-fbosch
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: skill-judge
Source: https://github.com/fbosch/dotfiles/tree/main/.agents/skills/skill-judge
Command: npx skills add https://github.com/fbosch/dotfiles --skill skill-judge-fbosch

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill provides a rigorous framework to evaluate Agent Skills (SKILL.md) and Skill packages against official specifications, enabling consistent quality scoring and actionable improvements.

Core Features & Use Cases

  • Defines evaluation dimensions (D1-D8) including Knowledge Delta, Mindset, Anti-Pattern Quality, Specification Compliance, Progressive Disclosure, Freedom Calibration, Pattern Recognition, and Practical Usability.
  • Provides a structured scoring protocol, a detailed evaluation workflow, and a standardized Skill Evaluation Report template.
  • Useful for audits, calibration, and improvement of Skills across projects to ensure consistent activation and performance.

Quick Start

Run a Skill Evaluation Report on the target SKILL.md to generate dimension scores and a structured improvement plan.

Frequently Asked Questions about skill-judge

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I audit a SKILL.md file for specification compliance?

To audit a SKILL.md file for specification compliance, run a Skill Evaluation Report. This assesses the file against official specifications across 8 evaluation dimensions to ensure robust guidance for AI agents.

What is the best way to score Agent Skills for quality and consistency?

Scoring Agent Skills for quality requires a structured protocol evaluating 8 dimensions, including Knowledge Delta, Mindset, and Anti-Pattern Quality. This generates a dimensional evaluation with a final score and recommended improvements.

Can I use this skill evaluation framework to calibrate skills across multiple projects?

Yes, you can use this skill evaluation framework to calibrate skills across multiple projects. It applies a standardized scoring protocol and report template to ensure consistent activation and performance evaluation.

What evaluation dimensions are checked during a documentation audit?

A documentation audit checks 8 evaluation dimensions: Knowledge Delta, Mindset, Anti-Pattern Quality, Specification Compliance, Progressive Disclosure, Freedom Calibration, Pattern Recognition, and Practical Usability.

Does skill calibration require any dependencies or specific components?

Skill calibration requires no external dependencies or specific components. The evaluation operates directly on your target SKILL.md files and skill packages to produce a structured improvement plan.

How do I get actionable improvements from a skill report?

To get actionable improvements from a skill report, the evaluation workflow outputs a structured Skill Evaluation Report. This report contains dimension scores and a recommended improvement plan based on specification compliance.