Skills
.Work. You
Rest

eval-consistency

Community

Test persona roleplay consistency reliably.

Data & Analytics#local-first#scoring rubric#LLM testing#persona evaluation#roleplay consistency#benchmark report
AuthorYIKUAIBANZI
Version1.0.0
Installs0

System Documentation

What problem does it solve?

This Skill helps you evaluate whether a use-persona roleplay matches a given persona’s defining traits, including expression style, interaction behavior, and hard boundaries.

Core Features & Use Cases

  • Persona-driven scenario testing: Runs the same persona against multiple dialogue scenarios to generate replies.
  • Multi-dimension scoring: Scores each reply across five dimensions (length, catchphrases, punctuation/tone, interaction mode, and boundary compliance).
  • Actionable consistency report: Produces a per-scenario breakdown plus averages, pass/fail status (70+ target), common issues, and improvement suggestions.

Quick Start

Ask the AI to run the evaluation by saying: "/eval-consistency" with your persona and scenario inputs already available in the repository paths.

Dependency Matrix

Required Modules

None required

Components

Standard package

đŸ’» Claude Code Installation

Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.

Please help me install this Skill:
Name: eval-consistency
Download link: https://github.com/YIKUAIBANZI/forge-skill/archive/main.zip#eval-consistency

Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
View Source Repository

Agent Skills Search Helper

Install a tiny helper to your Agent, search and equip skill from 471,000+ vetted skills library on demand.