judge-criteria-designer

Design testable judge criteria and structured action proposals for agent action boundaries.

Updated Jul 16, 2026
One-click install
npx skills add https://github.com/Cloud-Byte-Consulting/plugins --skill judge-criteria-designer-cloud-byte-consulting
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: judge-criteria-designer
Source: https://github.com/Cloud-Byte-Consulting/plugins/tree/main/prompt-workflows/skills/judge-criteria-designer
Command: npx skills add https://github.com/Cloud-Byte-Consulting/plugins --skill judge-criteria-designer-cloud-byte-consulting

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve? When an AI agent is about to take a real-world action (sending an email, opening a PR, updating a CRM record), teams often lack concrete, testable rules for deciding whether the action is authorized and safe. This Skill turns a vague action boundary into a rigorous judgment specification. ## Core Features & Use Cases - Judge Criteria Specification: Produces testable yes/no or confidence-level questions across four categories: authorization, evidence, exposure & risk, and policy. - Action Proposal Format: Designs a structured template the actor must complete before execution, covering intended action, evidence, authorization basis, reversibility, and risk flags. - Failure Mode Analysis: Ends with the three most common mundane failure modes at the boundary and maps each to the criteria that catch it. - Use Case: Before letting a support agent send customer emails autonomously, use this Skill to define what counts as valid authorization, what evidence the agent must cite, and when a human must approve. ## Quick Start Ask the agent to design judge criteria and an action proposal format for the boundary where your agent sends customer follow-up emails.

Frequently Asked Questions about judge-criteria-designer

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I design judge criteria for an AI agent action?

Describe the action boundary, domain, existing policies, and worst-case failure to the agent. It produces testable yes/no criteria across authorization, evidence, exposure and risk, and policy categories, plus decision rules for allow, block, revise, or escalate.

What is an action proposal format for AI agents?

An action proposal is a structured object the actor agent must produce before executing, with fields for intended action, reason, supporting evidence, authorization basis, expected consequence, data exposed, reversibility, and risk flags. The judge inspects this proposal before execution.

When should an AI agent action require human approval?

Human-in-the-loop approval is needed when the action is irreversible, exposes sensitive data, has ambiguous authorization, or crosses legal, security, or compliance boundaries. The Skill flags these conditions and designs criteria that surface ambiguity rather than resolving it silently.

What are common failure modes at agent action boundaries?

Common failures include acting on inferred rather than explicit authorization, citing stale or insufficient evidence, and exposing data to unintended recipients. The Skill ends each design with the three most likely mundane failures and maps each to the criteria that catch it.

Can judge criteria handle unwritten or implicit policies?

The Skill does not invent policies the user has not described. When policy gaps exist, it flags them explicitly and suggests what the user needs to define, keeping criteria grounded in stated rules and norms.