skill-creator

Create, modify, and evaluate AI skills with SKILL.md files and performance tests.

8.7k|1.8k|Updated Feb 1, 2012
One-click install
npx skills add https://github.com/getsentry/sentry-javascript --skill skill-creator-getsentry
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: skill-creator
Source: https://github.com/getsentry/sentry-javascript/tree/main/.agents/skills/skill-creator
Command: npx skills add https://github.com/getsentry/sentry-javascript --skill skill-creator-getsentry

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) and assets (resource) components.

What problem does it solve?

This Skill streamlines the entire process of creating, improving, and evaluating AI-powered skills, making it easier to build powerful and accurate AI tools.

Core Features & Use Cases

  • Skill Creation: Guides users through defining intent, writing SKILL.md, and structuring skill directories.
  • Iterative Improvement: Facilitates testing, feedback collection, and refinement of skills based on performance metrics.
  • Description Optimization: Enhances skill triggering accuracy by testing and optimizing the description field.
  • Use Case: You have an idea for a new AI skill to help draft legal documents. Use this Skill to define its purpose, write the initial SKILL.md, set up test cases, run evaluations, and iterate on the skill's logic and description until it performs perfectly.

Quick Start

Use the skill-creator to help me build a new skill for summarizing meeting transcripts.

Frequently Asked Questions about skill-creator

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I create and test AI skills?

You create and test AI skills by defining intent, drafting a `SKILL.md` file, setting up test cases, and running evaluations. This iterative development process uses feedback loops and performance benchmarks to refine skill logic and optimize descriptions for accurate triggering.

What is the best way to optimize AI skill descriptions for better triggering?

The best way to optimize AI skill descriptions is by testing the `description` field against established test cases. Running evaluations and applying performance benchmarks allows you to iteratively refine the description to improve triggering accuracy.

How does iterative development work for prompt engineering?

Iterative development for prompt engineering works by running evaluations on test cases, collecting performance metrics, and refining the `SKILL.md` logic. Feedback loops guide the optimization process until the AI skill meets the desired performance benchmarks.

Can I evaluate AI skill performance without writing extensive custom scripts?

Yes, you can evaluate AI skill performance using included scripts and references to set up test cases. The skill-creator guides you through running these evaluations and measuring performance benchmarks without requiring extensive external custom scripts.

Do I need to structure directories specifically when building AI skills?

Yes, you need to structure skill directories specifically when building AI skills. Structuring directories correctly ensures that the `SKILL.md` file, scripts, references, and assets are properly organized for the skill to function and trigger accurately.

Why are my AI skills not triggering accurately in evaluations?

AI skills fail to trigger accurately in evaluations when the `description` field is poorly optimized. You must run iterative development tests, analyze performance benchmarks, and refine the description to improve the skill's triggering accuracy.