agent

Evaluate AI agent artifacts against a predefined rubric with weighted scores.

Updated Mar 10, 2026
One-click install
npx skills add https://github.com/Ankh-Studio/copilot-enterprise-eval-plugin --skill agent-ankh-studio
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: agent
Source: https://github.com/Ankh-Studio/copilot-enterprise-eval-plugin/tree/main/skills/agent
Command: npx skills add https://github.com/Ankh-Studio/copilot-enterprise-eval-plugin --skill agent-ankh-studio

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

This Skill automates the evaluation of AI agents against a structured rubric, providing objective feedback for improvement.

Core Features & Use Cases

  • Automated Scoring: Assigns weighted scores to key agent characteristics like persona, expertise, and reliability.
  • Detailed Feedback: Generates actionable insights on strengths and areas needing enhancement.
  • Use Case: A development team can use this Skill to consistently assess new AI agents before deployment, ensuring they meet quality standards for persona definition, domain expertise, and task specialization.

Quick Start

Use the agent skill to evaluate the agent located at .github/agents/customer-support-agent/AGENT.md.

Frequently Asked Questions about agent

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I evaluate an AI agent against a rubric?

To evaluate an AI agent against a rubric, use this Skill to score agent artifacts by assessing persona definition, domain expertise, task specialization, interaction quality, and reliability. It requires a structured AGENT.md file and generates weighted scores with detailed improvement feedback.

What is automated agent quality assessment?

Automated agent quality assessment is the process of scoring AI agent artifacts against predefined rubric criteria. This mechanism assigns weighted scores to characteristics like persona and expertise, generating actionable feedback for agent improvement.

How do I generate feedback for AI agent improvement?

You generate feedback for AI agent improvement by processing a structured AGENT.md file through this evaluation Skill. It analyzes domain expertise and persona definition, returning detailed insights on strengths and areas needing enhancement.

Do I need a structured AGENT.md file to score agent persona and expertise?

Yes, you need a structured AGENT.md file to score agent persona and expertise. The evaluation requires this file alongside a predefined rubric to accurately assess domain expertise, task specialization, interaction quality, and reliability.

What's the best way to score AI agent characteristics before deployment?

The best way to score AI agent characteristics before deployment is using an automated rubric evaluation. This approach consistently assesses persona definition, domain expertise, task specialization, and reliability, returning weighted scores to ensure quality standards are met.

What are the limitations of automated persona assessment for AI agents?

A limitation of automated persona assessment is its strict dependency on a predefined rubric and a structured AGENT.md file. Without accurate artifact inputs, the evaluation cannot generate reliable weighted scores or actionable feedback for agent improvement.