agentic-eval

Identify evaluation patterns for agent output refinement with rubric-based scoring.

Updated Aug 27, 2026
One-click install
npx skills add https://github.com/j-mckerracher/agent-research --skill agentic-eval-j-mckerracher
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: agentic-eval
Source: https://github.com/j-mckerracher/agent-research/tree/main/dated-agents/4-6-2026/.claude/skills/agentic-eval
Command: npx skills add https://github.com/j-mckerracher/agent-research --skill agentic-eval-j-mckerracher

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Patterns and techniques for evaluating and improving AI agent outputs, enabling self-critique loops and robust evaluation pipelines to raise the quality of agent decisions and plans.

Core Features & Use Cases

  • Self-critique and reflection: Build loops where agents critique their own outputs and propose refinements.
  • Evaluator-optimizer workflows: Separate generation and evaluation to tighten quality and reliability.
  • Code and document refinement: Apply rubric-based or LLM-as-judge evaluation to code, reports, and analyses.
  • Rubric-based scoring: Use structured dimensions to guide improvements and guardrails.

Quick Start

Provide an initial response to a task, then run a structured self-evaluation loop to iteratively improve it until criteria are met.

Frequently Asked Questions about agentic-eval

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I build a self-critique loop for AI agents to improve their outputs?

Build self-critique loops for AI agents by applying iterative evaluation patterns where agents assess their own outputs against structured rubrics and propose refinements until quality criteria are met.

What is an evaluator-optimizer workflow for AI agents?

An evaluator-optimizer workflow separates generation and evaluation into distinct phases to tighten reliability, using rubric-based scoring and JSON-structured feedback to guide iterative improvements.

How do I apply rubric-based scoring to code reviews and data analysis?

Apply rubric-based scoring to code reviews and data analysis by configuring evaluation loops with structured dimensions, enabling LLM-as-judge evaluation to guide improvements and enforce safe guardrails.

Can I use self-critique loops for high-stakes decision-making prompts?

Yes, you can use self-critique loops for high-stakes decision-making prompts by applying configurable evaluation loops and safe guardrails to prevent unsafe prompts while assessing and improving agent decisions.

What is the best way to structure feedback for iterative agent refinement?

The best way to structure feedback for iterative agent refinement is using JSON-structured feedback, which provides organized, machine-readable evaluation data to systematically guide output improvements.

When should I not use automated self-evaluation loops on AI outputs?

Avoid using automated self-evaluation loops when tasks lack clear quality criteria for rubric-based scoring or when safe guardrails cannot adequately prevent unsafe prompts in highly subjective contexts.