What problem does it solve?
This Skill Unit addresses the challenges of creating, iterating, and optimizing AI skills, streamlining the process for both skill developers and end-users.
Core Features & Use Cases
- Skill Creation: Guide users through crafting new skills from scratch, including capturing intent, designing test cases, and running evaluations.
- Skill Modification: Enable users to modify existing skills based on evaluation feedback, with options for optimizing performance and description accuracy.
- Skill Benchmarking: Provide quantitative analysis of skill performance, including pass rates, execution times, and token usage.
- Description Optimization: Offer tools to refine skill descriptions for improved triggering accuracy and relevance.
- Use Case: Imagine a user wants to create a skill for generating financial reports. The Skill Unit can assist with designing the skill's behavior, setting up test cases, and optimizing its description for better triggering.
Quick Start
To create a new skill, run the following commands:
create_skill "generate financial report" "Generate financial reports from provided data"
