google-agents-cli-eval

Name: google-agents-cli-eval
Availability: InStock
Author: Google

Evaluate ADK agents' tool calls, response accuracy, and safety compliance.

5.5k|588|Updated Apr 8, 2026

Search Tags:#automation #testing #metrics #evaluation #adk #agent assessment #evalset

Ready to run

npx skills add https://github.com/google/agents-cli --skill google-agents-cli-eval

💬 Prompt for ChatGPT / Claude Chat▼

Please help me install this Agent Skill.
Skill: google-agents-cli-eval
Source: https://github.com/google/agents-cli/tree/main/skills/google-agents-cli-eval
Command: npx skills add https://github.com/google/agents-cli --skill google-agents-cli-eval

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires agents-cli, and includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill facilitates comprehensive testing and assessment of ADK (Agent Development Kit) agents, including their evaluation metrics, evalset schemas, and evaluation loop methodology.

Core Features & Use Cases

Evaluation Setup: Guides users in configuring evalsets, criteria, and custom metrics for thorough agent testing.
Evaluation Execution: Enables running automated evals with detailed scoring and analysis.
Use Case: A development team wants to measure an agent’s tool usage accuracy and response quality, iterating until they achieve desired thresholds before deployment.

Quick Start

Use the eval skill to run evaluation tests on your agent and analyze the resulting scores to improve performance.

Frequently Asked Questions about google-agents-cli-eval

High-intent search queries and answers about installing and using this skill.

FAQPage Schema

How do I evaluate ADK agent performance and tool call accuracy?▼

You evaluate ADK agent performance by configuring evalsets and custom metrics to measure tool call accuracy, response quality, and safety compliance. This process allows development teams to iterate until achieving desired thresholds before deployment.

What are evalsets and how do they work in agent testing?▼

Evalsets are customizable schemas and criteria used for thorough ADK agent testing. They enable automated evaluation loops with detailed scoring and analysis to measure an agent's tool usage accuracy and response quality.

How do I set up custom metrics for automated agent evaluation?▼

You set up custom metrics for automated agent evaluation by configuring specific criteria within evalsets. This guides the evaluation loop to generate detailed scores analyzing tool usage and response accuracy.

Do I need the agents-cli to run ADK evaluation tests?▼

Yes, the agents-cli is a required dependency to run ADK evaluation tests. It provides the necessary environment to execute automated evals and analyze resulting scores to improve agent performance.

Can I measure safety compliance and response accuracy for ADK agents?▼

Yes, you can measure safety compliance and response accuracy for ADK agents. The evaluation process uses customizable schemas and metrics to assess these aspects alongside tool call accuracy during testing.