recognizable-quality-test-generator

Generate a structured quality rubric with pass/fail criteria and calibration steps.

4|1|Updated Apr 11, 2026
One-click install
npx skills add https://github.com/m2ai-portfolio/m2ai-skills-pack --skill recognizable-quality-test-generator
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: recognizable-quality-test-generator
Source: https://github.com/m2ai-portfolio/m2ai-skills-pack/tree/main/skills/recognizable-quality-test-generator
Command: npx skills add https://github.com/m2ai-portfolio/m2ai-skills-pack --skill recognizable-quality-test-generator

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Generates a structured, verifiable rubric that an agent can use as a judge to evaluate its own outputs and determine pass/fail criteria.

Core Features & Use Cases

  • Converts a workflow description and 3–5 historical outputs into a formal evaluation rubric with 4–8 criteria.
  • Produces a self-contained LLM-as-judge prompt that can be embedded into an agent's evaluation step.
  • Supports calibration workflows to refine criteria based on outcome examples.

Quick Start

Provide a workflow description and 3–5 historical outputs to generate the judge rubric.

Frequently Asked Questions about recognizable-quality-test-generator

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I create an LLM-as-judge prompt to evaluate agent outputs?

To create an LLM-as-judge prompt, provide a workflow description and 3–5 historical outputs. The skill generates a self-contained judge prompt with verifiable criteria, pass/fail conditions, and calibration steps to evaluate agent outputs.

What is a quality rubric for agent evaluation and when do I need one?

A quality rubric for agent evaluation is a structured set of 4–8 verifiable criteria used to judge outputs. You need one when an agent requires formal pass/fail success criteria and self-evaluation steps to ensure output reliability.

How do I calibrate evaluation criteria using historical examples?

You calibrate evaluation criteria by inputting 3–5 historical outputs into the generator. It applies a calibration workflow that refines the rubric based on those outcome examples, producing a formal evaluation standard.

Can I embed a generated judge rubric directly into my agent workflow?

Yes, you can embed the generated judge rubric directly. The skill outputs a self-contained LLM-as-judge prompt that includes workflow context, criteria, final verdict logic, and pass/fail conditions for integration into agent evaluation steps.

What do I need to generate a structured quality rubric for prompt engineering?

You need a workflow description and 3–5 historical outputs to generate a structured quality rubric. These inputs allow the tool to produce formal evaluation criteria and a self-contained judge prompt for prompt engineering workflows.