setup-evaluation

Validate process decompositions and architecture designs against structural errors and handoff protocols.

3|Updated Apr 5, 2026
One-click install
npx skills add https://github.com/dvy1987/agent-loom --skill setup-evaluation
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: setup-evaluation
Source: https://github.com/dvy1987/agent-loom/tree/main/.agents/skills/setup-evaluation
Command: npx skills add https://github.com/dvy1987/agent-loom --skill setup-evaluation

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Prevents wasted execution and costly agent runs by detecting structural errors, missing handoffs, orphan steps, unrealistic step ordering, and knowledge gaps before any agent executes a plan.

Core Features & Use Cases

  • Independent Evaluation: Runs as a separate setup-evaluator agent to avoid confirmation bias from builders.
  • Decomposition & Architecture Checks: Verifies step coverage, tool availability, parallelism, topology match, agent boundaries, and handoff protocols.
  • Clear Verdicts & Escalation: Produces PASS/FAIL reports with enumerated issues and guidance, and escalates to the user after repeated failures.
  • Use Case: Review a multi-agent process and architecture spec for a complex deployment pipeline to ensure all steps are assigned and handoffs are defined.

Quick Start

Evaluate the setup for proc-2026-04-10-012 using the process entry path and architecture spec path to receive a PASS or FAIL report with actionable issues.

Frequently Asked Questions about setup-evaluation

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I validate multi-agent process decompositions and architecture designs before execution?

To validate process decompositions and architecture designs, an independent evaluator checks step coverage, handoff protocols, and topology alignment. This setup evaluation reads your markdown artifacts to detect orphan steps and structural mismatches, producing a PASS or FAIL report with remediation guidance.

Why do my multi-agent workflows fail due to undefined handoffs and orphan steps?

Multi-agent workflows fail from undefined handoffs and orphan steps when process and architecture specs lack independent review. A setup evaluation catches these structural errors and topology mismatches before execution, preventing wasted agent runs and costly deployment failures.

What is the best way to review agent-chain orchestration setup for topology mismatches?

The best way to review agent-chain orchestration for topology mismatches is running an independent setup-evaluator agent. It verifies topology alignment, agent boundaries, and handoff protocols against your architecture specifications, avoiding the confirmation bias from builders evaluating their own designs.

Can I evaluate project setup markdown artifacts for parallelism and tool availability?

Yes, you can evaluate project setup markdown artifacts for parallelism and tool availability. The setup evaluation verifies step coverage and tool availability within your process decomposition, ensuring all steps are assigned and execution requirements are met before returning a verdict.

Does architecture review for agent workflows require separate process and architecture specifications?

Yes, architecture review for agent workflows requires separate process and architecture markdown artifacts. The evaluator reads both to check step coverage, handoff protocols, and topology alignment, ensuring process entries and architecture specifications match before execution.

What happens when repeated architecture reviews fail to resolve structural errors?

When repeated architecture reviews fail to resolve structural errors, the setup evaluation escalates to the user. After producing multiple FAIL reports with enumerated issues and remediation guidance, the evaluator forwards the unresolved handoff protocols and topology mismatches for manual intervention.