skills.rest
jaem1n207
jaem1n207COMMUNITY
Explore all skills by this author →
WebsiteGitHub

skill-creator

Create and refine AI skills with SKILL.md metadata and test cases.

18|Updated Jul 12, 2023
Search Tags:#skill development#prompt engineering#optimization#evaluation#ai tools#llm skills
One-click install
npx skills add https://github.com/jaem1n207/synchronize-tab-scrolling --skill skill-creator-jaem1n207
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: skill-creator
Source: https://github.com/jaem1n207/synchronize-tab-scrolling/tree/main/.agents/skills/skill-creator
Command: npx skills add https://github.com/jaem1n207/synchronize-tab-scrolling --skill skill-creator-jaem1n207

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) and assets (resource) components.

What problem does it solve?

This Skill streamlines the entire process of creating and improving AI skills, from initial concept to performance optimization, making AI development accessible and efficient.

Core Features & Use Cases

  • Skill Creation: Guides users through defining intent, interviewing for edge cases, and writing SKILL.md files.
  • Iterative Improvement: Facilitates testing, evaluation, and refinement of skills based on performance metrics and user feedback.
  • Description Optimization: Enhances skill triggering accuracy by optimizing the description field for better AI understanding.
  • Use Case: A developer wants to create a new skill to summarize meeting transcripts. They use this Skill to draft the SKILL.md, write test cases, run evaluations, analyze the results, and iterate on the skill's instructions and description until it performs optimally.

Quick Start

Use the skill-creator to help me build a new skill that can summarize meeting transcripts.

Frequently Asked Questions about skill-creator

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I create and test AI skills from scratch?▼

To create and test AI skills, you define the skill intent, author the SKILL.md metadata, generate test cases, and run performance benchmarking. This skill facilitates the entire end-to-end lifecycle, including iterative refinement based on evaluation results.

What is the best way to optimize AI skill descriptions for better triggering accuracy?▼

Optimizing AI skill descriptions involves refining the metadata fields to improve LLM understanding and triggering accuracy. This skill analyzes benchmark results to enhance your skill descriptions, ensuring the AI triggers the correct skill during execution.

How does performance benchmarking work for custom LLM skills?▼

Performance benchmarking for custom LLM skills works by generating and executing test cases against your skill, then analyzing the results. This skill integrates with evaluation frameworks to measure performance and guide iterative improvements.

Can I use this skill to handle edge cases during prompt engineering?▼

Yes, you can use this skill to handle edge cases during prompt engineering. It guides users through defining intent and interviewing for edge cases, ensuring your SKILL.md instructions are robust before executing test evaluations.

Do I need any dependencies to run evaluations on my AI tools?▼

You do not need any dependencies to run evaluations on your AI tools. This skill operates independently with integrated evaluation and testing frameworks, allowing you to analyze benchmark results immediately without external packages.

Related Skills

Explore More Software Engineering Skills→
yangliu2060yangliu2060
39

youtube-video-analyzer

Extract YouTube transcripts and captions into structured summaries with key points.

Community
Basic
Citrus-bitCitrus-bit
135

skill-creator

Orchestrates skill creation, evaluation, benchmarking, and description optimization workflows for Claude Skills.

Community
Advanced
Marwan78888Marwan78888
16

prompt-engineer

Design prompts for LLM tasks with structured schemas and evaluation rubrics.

Community
Advanced
mneves75mneves75
74

writing-skills

Apply Test-Driven Development to create and test AI skills.

Community
Intermediate