skills.rest
asmartbear
asmartbearCOMMUNITY
Explore all skills by this author →
Website𝕏@asmartbearGitHub

exercise-asb-skill

Simulate user scenarios for asb-* skills and evaluate performance against a rubric.

4|Updated Jun 3, 2026
Search Tags:#skill development#AI testing#performance evaluation#rubric-based assessment#skill simulation
One-click install
npx skills add https://github.com/asmartbear/asb-skills --skill exercise-asb-skill
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: exercise-asb-skill
Source: https://github.com/asmartbear/asb-skills/tree/main/.claude/skills/exercise-asb-skill
Command: npx skills add https://github.com/asmartbear/asb-skills --skill exercise-asb-skill

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) components.

What problem does it solve?

This Skill provides a simulation environment to test and evaluate the performance of asb-* skills, ensuring they meet the required standards of accuracy and effectiveness.

Core Features & Use Cases

  • Simulation of User Scenarios: Role-plays realistic user scenarios to assess the skill's response and adherence to a predefined rubric.
  • Verdict Table and Patch List: Generates a detailed report with a verdict table and a patch list for identified issues.
  • Use Case: Before releasing a new asb-* skill, use this Skill to simulate interactions and identify any areas that need improvement.

Quick Start

To exercise the 'asb-rude-qa' skill, run the command: /exercise-asb-skill asb-rude-qa <path-to-draft>

Frequently Asked Questions about exercise-asb-skill

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I evaluate AI skill performance against a rubric before release?▼

To evaluate AI skill performance, simulate user scenarios and assess responses against a fixed rubric to identify areas for improvement before release.

What is rubric-based assessment for skill simulation?▼

Rubric-based assessment for skill simulation is a testing method that role-plays user scenarios to measure an AI skill's accuracy and effectiveness against predefined criteria.

How do I test a draft AI skill using scenario simulation?▼

Test a draft AI skill by providing its SKILL.md file and draft version to the simulation command, which generates a verdict table and patch list for issues found.

Do I need a published version to run a performance evaluation on a skill?▼

No, a published version is not strictly required for performance evaluation; you can test a draft version as long as you provide the skill's SKILL.md file.

What output do I get from simulating user scenarios for skill testing?▼

Simulating user scenarios for skill testing produces a detailed report containing a verdict table and a patch list identifying specific areas needing improvement.

Can I use this skill simulation to test skills outside of the asb-* format?▼

No, this skill simulation is specifically designed to test and evaluate the performance of skills matching the asb-* format against a fixed rubric.

Related Skills

Explore More Software Engineering Skills→
dnzengoudnzengou

aeon-autoresearch

Generate four skill variations, score them, and apply the best one.

Community
Advanced
simondhallidaysimondhalliday

mcq-skill-improver

Evaluate MCQs against a standardized rubric and identify failure modes.

Community
Advanced
ther7777ther7777
2

trump-perspective

Emulate Donald Trump's speech patterns and decision-making for role-play and analysis.

Community
Advanced
ollieb89ollieb89

llm-evaluation

Evaluate LLM outputs with automated metrics and LLM-as-Judge workflows.

Community
Advanced