create-skill-test
CommunityScaffold skill eval tests the right way
Software Engineering#agent skills#test scaffolding#rubric design#eval.yaml#fixture setup#overfitting avoidance
Author1k-off
Version1.0.0
Installs0
System Documentation
What problem does it solve?
It eliminates slow, error-prone setup of eval.yaml skill test scaffolding by generating correctly structured evaluation tests that match the dotnet/skills repository conventions.
Core Features & Use Cases
- Creates evaluation scaffolding: Generates the right
tests/<plugin>/<skill-name>/eval.yamldirectory structure for skill tests. - Builds robust scenarios: Helps define scenarios with prompts, assertions, and rubric items while reducing prompt/rubric overfitting.
- Organizes fixtures safely: Supports test fixture organization via directory copying or inline/fixture-based file setup so scenarios run reliably.
Quick Start
Use this skill to scaffold a new tests/<plugin>/<skill-name>/eval.yaml file with well-formed scenarios, assertions, rubric items, and optional fixtures for a specific skill you are validating.
Dependency Matrix
Required Modules
None requiredComponents
Standard package💻 Claude Code Installation
Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.
Please help me install this Skill: Name: create-skill-test Download link: https://github.com/1k-off/umbraco-observability-playground/archive/main.zip#create-skill-test Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
Agent Skills Search Helper
Install a tiny helper to your Agent, search and equip skill from 471,000+ vetted skills library on demand.