agentic-eval

Evaluate and iteratively refine AI agent outputs using C# and Microsoft.Extensions.AI.

1|Updated Mar 1, 2026
One-click install
npx skills add https://github.com/rudironsoni/SharpClaw --skill agentic-eval-rudironsoni
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: agentic-eval
Source: https://github.com/rudironsoni/SharpClaw/tree/main/.github/skills/agentic-eval
Command: npx skills add https://github.com/rudironsoni/SharpClaw --skill agentic-eval-rudironsoni

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill addresses the challenge of ensuring AI-generated content meets specific quality standards by enabling agents to critically evaluate and iteratively improve their own outputs.

Core Features & Use Cases

  • Self-Critique: Agents can assess their responses against defined criteria.
  • Iterative Refinement: The skill facilitates loops of generation, evaluation, and correction.
  • Use Case: When generating complex code, an agent can use this skill to write the code, then test it against provided unit tests, and if it fails, refine the code based on the test errors.

Quick Start

Use the agentic-eval skill to generate C# code for a given specification and iteratively fix any errors found during testing.

Frequently Asked Questions about agentic-eval

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I use LLM-as-judge for self-correction in AI code generation?

LLM-as-judge self-correction evaluates AI code generation against defined criteria, enabling iterative refinement loops. Agents generate code, test it against specifications, and automatically refine outputs based on test errors to achieve higher quality.

What is the evaluator-optimizer pattern for AI agent refinement?

The evaluator-optimizer pattern is an iterative generation mechanism where an AI agent assesses its own outputs against evaluation criteria. It facilitates loops of generation, evaluation, and correction to improve quality-critical tasks like code and reports.

Can I implement reflection patterns for AI evaluation using C# and Microsoft.Extensions.AI?

Yes, you can implement reflection patterns for AI evaluation using C# and Microsoft.Extensions.AI. The skill provides specific patterns and techniques for self-evaluation and iterative refinement within the .NET ecosystem.

How do I iteratively fix C# code errors found during unit testing?

To iteratively fix C# code errors, an agent generates code for a specification, tests it against provided unit tests, and if it fails, refines the code based on the test errors. This loop continues until quality standards are met.

When do I need self-reflection for AI-generated reports and analysis?

You need self-reflection for AI-generated reports and analysis when clear evaluation criteria exist and outputs are quality-critical. It allows agents to critically evaluate and iteratively improve their own responses to meet specific standards.