santa-method

Verifies generated output using two independent review agents with a convergence loop.

2|Updated Mar 29, 2015
One-click install
npx skills add https://github.com/ovisan/dotfiles --skill santa-method-ovisan
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: santa-method
Source: https://github.com/ovisan/dotfiles/tree/main/.agents/skills/santa-method
Command: npx skills add https://github.com/ovisan/dotfiles --skill santa-method-ovisan

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve? A single agent reviewing its own output shares the same biases and blind spots that produced the errors, so hallucinations, compliance violations, and inaccuracies slip through to production. This Skill enforces adversarial dual review before anything ships. ## Core Features & Use Cases - Dual Independent Review: Two isolated reviewer agents evaluate output against the same rubric with no shared context, and both must pass before shipping. - Convergence Loop: Flagged issues are fixed and re-reviewed by fresh agents each round, with a max-iteration cap and human escalation on exhaustion. - Structured Rubrics & Verdicts: Objective pass/fail criteria with domain extensions for content, code, and compliance-sensitive output, returned as typed JSON verdicts. - Use Case: Before publishing 200 AI-generated product descriptions, run Santa verification on a 15% sample, classify failure patterns, batch-fix systematic issues, and re-sample until a clean pass. ## Quick Start Verify this generated output by having two independent reviewers check it against my rubric and fix any flagged issues until both pass.

Frequently Asked Questions about santa-method

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I verify AI-generated content for hallucinations before publishing?▼

Use dual independent review: spawn two reviewer agents with no shared context, give both the same rubric and output, and require both to return PASS verdicts. Fix flagged issues and re-run fresh reviewers until convergence, capping at three iterations before escalating to a human.

What is multi-agent adversarial verification?▼

Multi-agent adversarial verification uses two or more independent review agents to check generated output against an objective rubric. Because reviewers share no context, they avoid the correlated blind spots of self-review, and both must pass before output ships.

How do I design a review rubric for AI output quality checks?▼

Define criteria with objective pass/fail conditions: factual accuracy, hallucination-free claims, completeness against the spec, compliance constraints, internal consistency, and technical correctness. Add domain extensions for content, code, or regulated industries. Vague rubrics produce vague reviews.

When should I not use dual-agent output verification?▼

Skip it for internal drafts, exploratory research, and tasks with deterministic verification like build, lint, or test pipelines. It costs roughly 2-3x generation tokens per cycle, so reserve it for published, deployed, or compliance-sensitive output.

How do I verify large batches of AI-generated content cost-effectively?▼

Use stratified sampling: run full dual review on 10-15% of the batch (minimum 5 items), classify failures by type, apply targeted fixes across the whole batch, then re-sample. This catches over 90% of systematic issues at 15-20% of full verification cost.

Why do both reviewers keep finding new issues after fixes?▼

This is the infinite loop failure mode, where fixes introduce regressions or reviewers drift to new concerns. Cap iterations at three, instruct fix agents to change only flagged issues, and escalate to a human when the cap is exhausted.