evaluation-design

Guide AI evaluation design and review against a 7-dimension rubric.

Updated Feb 24, 2026
One-click install
npx skills add https://github.com/DouwMarx/evaluating-evaluations --skill evaluation-design-douwmarx
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: evaluation-design
Source: https://github.com/DouwMarx/evaluating-evaluations/tree/main/evaluation-design
Command: npx skills add https://github.com/DouwMarx/evaluating-evaluations --skill evaluation-design-douwmarx

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires evaluation-framework, and includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill addresses the complexity and ambiguity of AI evaluation design and review, enabling a structured approach for safety evaluations against the 7-dimension rubric.

Core Features & Use Cases

  • Evaluation Design Review: Guides through the EquiStamp evaluation development process (Phase 3).
  • Design or Review Functionality: Supports design of new evaluations from Phase 2 measurement targets or review of existing designs.
  • Risk Assessment: Helps articulate risk questions and evaluate model uplift.
  • Rubric-based Evaluation: Scores and validates designs against a 7-dimension rubric.

Quick Start

Start by importing the evaluation design file into the skill to initiate the review process.

Frequently Asked Questions about evaluation-design

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I design an AI safety evaluation using a rubric?

To design an AI safety evaluation, import your measurement targets into the Skill to initiate the review process. It scores designs against a 7-dimension rubric, helps articulate risk questions, and evaluates model uplift.

What is the EquiStamp evaluation pipeline Phase 3?

The EquiStamp Phase 3 evaluation pipeline is the design and review stage for AI safety assessments. It processes risk estimation and causal pathway data from Phase 2 to design new evaluations or review existing designs against a 7-dimension rubric.

Do I need risk estimation data before starting AI evaluation design?

Yes, risk estimation and causal pathway data from Phase 2 are required before starting AI evaluation design. These measurement targets serve as the necessary inputs to assess model uplift and validate the design against the 7-dimension rubric.

Can I review an existing AI evaluation design instead of creating a new one?

Yes, you can review existing AI evaluation designs. The Skill supports reviewing existing designs by scoring and validating them against the 7-dimension rubric, alongside designing new evaluations from Phase 2 measurement targets.

How does model uplift assessment work in AI evaluation?

Model uplift assessment in AI evaluation works by measuring the incremental capabilities or risks a model introduces. This Skill incorporates uplift assessment to validate the evaluation design against the 7-dimension rubric using Phase 2 causal pathway data.