judge-prompt-writer

Write production-ready system prompts for LLM-as-judge validators with four-outcome decision logic.

Updated Jul 16, 2026
One-click install
npx skills add https://github.com/Cloud-Byte-Consulting/plugins --skill judge-prompt-writer-cloud-byte-consulting
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: judge-prompt-writer
Source: https://github.com/Cloud-Byte-Consulting/plugins/tree/main/prompt-workflows/skills/judge-prompt-writer
Command: npx skills add https://github.com/Cloud-Byte-Consulting/plugins --skill judge-prompt-writer-cloud-byte-consulting

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve? Designing a validator LLM that reliably approves, blocks, revises, or escalates agent actions is hard: vague criteria produce judges that rubber-stamp risky actions or block everything. This Skill guides you through writing a rigorous judge system prompt with explicit, testable decision rules. ## Core Features & Use Cases - Structured Judge Prompt Generation: Produces a complete judge system prompt with role definition, input expectations, a criteria checklist (authorization, evidence, exposure/risk, policy), and four decision outcomes (ALLOW, BLOCK, REVISE, ESCALATE). - Anti-Gaming Protections: Builds in instructions so the judge evaluates structured claims against evidence rather than the persuasiveness of the actor's prose, and escalates under uncertainty instead of defaulting to allow. - Implementation Guidance: Delivers runtime integration notes covering outcome handling, logging, and known limitations with recommendations for complementary checks. - Use Case: After defining judge criteria and an action proposal format for an agent that sends outbound emails, use this Skill to produce the validator prompt that inspects each proposed email before execution. ## Quick Start Use the judge-prompt-writer skill to write a judge system prompt for my agent that reviews outbound email action proposals.

Frequently Asked Questions about judge-prompt-writer

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I write a system prompt for an LLM-as-judge validator?

Provide the action type, judge criteria organized by authorization, evidence, exposure/risk, and policy, plus the actor's action proposal format. The Skill then generates a complete judge prompt with a criteria checklist, four decision outcomes, and structured reasoning requirements.

What decision outcomes should an LLM judge return?

The judge returns one of four outcomes: ALLOW when all criteria pass, BLOCK when a critical criterion fails, REVISE when the action needs a specific change, and ESCALATE when the action is ambiguous or high-stakes. Every decision must include the reasoning chain.

How do I prevent an LLM judge from being manipulated by persuasive proposals?

Include anti-gaming instructions requiring the judge to evaluate structured claims against cited evidence and explicit authorization, not the persuasiveness of the actor's prose. Uncertainty should produce ESCALATE rather than a default ALLOW.

When should I use an LLM judge versus deterministic rules?

Use an LLM judge for criteria requiring contextual judgment, such as policy interpretation or risk assessment. Deterministic rules remain better for hard constraints, and the Skill's limitations section recommends combining judges with deterministic checks and human review.

What are the limitations of a single LLM-as-judge prompt?

A single judge can become overloaded when too many criteria domains are combined, reducing reliability. The Skill flags this case and suggests splitting into specialist judges, plus adding deterministic rules and human review for high-stakes actions.