eval-authoring

Automates creation of rubrics, reference sets, and evaluation components for text-based acceptance criteria.

Updated May 16, 2026
One-click install
npx skills add https://github.com/ramboz/servo --skill eval-authoring-ramboz
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: eval-authoring
Source: https://github.com/ramboz/servo/tree/main/hosts/claude/skills/eval-authoring
Command: npx skills add https://github.com/ramboz/servo --skill eval-authoring-ramboz

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires python, anthropic, claude, and includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill simplifies the process of creating and installing evaluation criteria for text-judged acceptance criteria, allowing users to easily define and deploy evaluation rubrics.

Core Features & Use Cases

  • Criteria Authoring: Define and shape rubrics, reference sets, and evaluation parameters for text-based acceptance criteria.
  • Evaluation Freeze/Install: Freeze the evaluation criteria and install them into the project's evaluation harness.
  • Use Case: Create a rubric for evaluating the clarity of documentation by defining criteria such as grammatical correctness, clarity, and conciseness, then install the rubric into the project's evaluation harness for automated checking.

Quick Start

Use the /servo:eval-authoring skill to author a new evaluation by specifying a goal or AC set: /servo:eval-authoring from-goal "Evaluate the clarity of technical documentation."

Frequently Asked Questions about eval-authoring

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I create evaluation rubrics for text-based acceptance criteria?

Creating evaluation rubrics for text-based acceptance criteria is done by authoring rubric parameters and reference sets that define automated checking rules for project quality assurance, code review, or documentation evaluation.

How do I install evaluation criteria into a project harness?

To install evaluation criteria into a project harness, you freeze the authored rubrics and reference sets, which deploys them directly into the evaluation harness for automated acceptance criteria checking.

Do I need Python and the Anthropic API to author evaluation rubrics?

Yes, you need Python 3.9+ and access to the Anthropic Messages API or the claude CLI to author evaluation rubrics, as these dependencies provide the required judge transportation for criteria processing.

What is a reference set in text-judged acceptance criteria?

A reference set in text-judged acceptance criteria is a collection of evaluation components and parameters that defines the baseline for automated quality assurance checks and documentation evaluation.

Can I use this approach to evaluate technical documentation clarity?

Yes, you can evaluate technical documentation clarity by defining specific criteria such as grammatical correctness, clarity, and conciseness, then installing that rubric into the evaluation harness for automated checking.

Best way to automate code review evaluation criteria?

The best way to automate code review evaluation criteria is to author text-based rubrics and reference sets, then freeze and install them into the project's evaluation harness for automated quality assurance checking.