eval-tool-use

Evaluate LLM agent tool selection, argument validation, and sequencing.

Updated Apr 19, 2026
One-click install
npx skills add https://github.com/majidraza1228/eval-framework --skill eval-tool-use
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: eval-tool-use
Source: https://github.com/majidraza1228/eval-framework/tree/main/skills/eval-tool-use
Command: npx skills add https://github.com/majidraza1228/eval-framework --skill eval-tool-use

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Evaluate tool-use quality in LLM agents by assessing tool selection and argument construction. This guidance helps separate deterministic tool interactions from higher-level reasoning and promotes robust evaluation workflows.

Core Features & Use Cases

  • Tool selection audits: verify the agent chooses the correct tool for a given task.
  • Argument validation: ensure inputs to tools conform to expected schemas and constraints.
  • Sequencing and error handling: verify the order of tool calls and recovery after failures.
  • Use Case: Test a Claude agent with multiple tools to confirm it calls the right tool with appropriate arguments and handles tool errors gracefully.

Quick Start

Provide a trace of a tool-use session and run the evaluation to identify tool selection, argument, and sequencing issues.

Frequently Asked Questions about eval-tool-use

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I evaluate LLM tool selection and argument construction in my agent?

You evaluate LLM tool selection and argument construction by providing a trace of a tool-use session and running deterministic checks to identify tool selection, argument, and sequencing issues. This applies to Claude-style agents with function calling and API integrations.

How do I test tool sequencing and error handling for LLM agents?

Test tool sequencing and error handling by auditing the order of tool calls and verifying the agent's recovery after failures. This Skill applies structured tests to a tool-use session trace to validate that the agent handles tool errors gracefully.

Can I use this to audit an MCP server tool-calling workflow?

Yes, you can audit an MCP server tool-calling workflow. The evaluation applies to Claude-style agents with access to tools like MCP servers and API integrations, verifying tool selection, argument validation, and sequencing within the trace.

What is the best way to validate tool inputs conform to expected schemas?

The best way to validate tool inputs is to run argument validation checks on a tool-use session trace. This verifies that inputs to tools conform to expected schemas and constraints, separating deterministic tool interactions from higher-level reasoning.

Does this evaluation focus on agent reasoning or deterministic tool checks?

This evaluation focuses on deterministic tool checks rather than purely reasoning. It assesses how an LLM agent selects tools, constructs inputs, and sequences tool calls, applying structured tests for tool selection, argument validation, and error handling.