eval

Run skill eval cases and generate pass/fail scorecards with Haiku 4.5 subagents.

10|5|Updated Apr 10, 2026
One-click install
npx skills add https://github.com/rajitsaha/100xprism --skill eval-rajitsaha
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: eval
Source: https://github.com/rajitsaha/100xprism/tree/main/modules/eval
Command: npx skills add https://github.com/rajitsaha/100xprism --skill eval-rajitsaha

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) components.

What problem does it solve?

This Skill eliminates the manual, error-prone work of verifying whether your AI skills still trigger correctly and produce expected outputs after updates or changes, preventing broken or underperforming skills from being used in production workflows.

Core Features & Use Cases

  • Automated Eval Grading: Runs skill eval cases, fans out parallel subagents to grade each assertion with Haiku 4.5 for fast, structured pass/fail scorecards.
  • Trigger Overlap Linting: Catches skills that would fire on each other's prompts before grading, reducing false positives from overlapping skill triggers.
  • Use Case: After updating a skill in your 100xPrism toolkit, use this to run its evals and confirm it still triggers on its intended prompts and passes all output assertions without manual review.

Quick Start

Use the eval skill to run all evals for the recently updated copywriting skill and generate a full pass/fail scorecard.

Frequently Asked Questions about eval

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I run regression testing on AI skills after code changes?

Regression testing on AI skills uses automated eval grading to verify trigger accuracy and output quality after code changes. It fans out parallel Haiku 4.5 subagents to grade each assertion and generates a deterministic pass/fail scorecard.

What is AI skill evaluation and how does assertion grading work?

AI skill evaluation is the process of validating trigger accuracy and output quality before production release. Assertion grading works by deploying Haiku 4.5 subagents to evaluate each eval case and produce structured pass/fail scorecards.

How do I prevent overlapping skill triggers from causing false positives in eval tests?

Preventing overlapping skill triggers requires trigger overlap linting to detect skills that would fire on each other's prompts. This runs before assertion grading to reduce false positives and ensure accurate scorecard generation.

Can I use automated eval scoring with Claude Code, Cursor, and Copilot?

Automated eval scoring supports pre-release quality validation for AI coding tools including Claude Code, Cursor, and Copilot. It requires the eval-harness.py script to perform structural validation and render pass/fail scorecards.

What's the best way to validate AI skill quality without manual review?

Validating AI skill quality without manual review is best achieved through automated eval grading using Haiku 4.5 subagents. This approach provides deterministic pass/fail results for trigger accuracy and output assertions across all eval cases.

Why do I need an eval harness script for skill quality validation?

An eval harness script like eval-harness.py is needed for skill quality validation to perform structural validation and render scorecards. It orchestrates parallel Haiku 4.5 subagents to grade assertions and produce deterministic pass/fail results.