Generate LLM evaluation tests for MCP tool collections from discovery manifests.
npx skills add https://github.com/umbraco/Umbraco-MCP-Base --skill build-evals
Please help me install this Agent Skill. Skill: build-evals Source: https://github.com/umbraco/Umbraco-MCP-Base/tree/main/plugins/skills/build-evals Command: npx skills add https://github.com/umbraco/Umbraco-MCP-Base --skill build-evals
This Skill automates the creation of LLM evaluation tests for your MCP tool collections, ensuring robust and reliable AI agent behavior.
.discover.json and existing tool definitions.Use the build-evals skill to generate LLM eval tests for all MCP tool collections.
High-intent search queries and answers about installing and using this skill.
This Skill automates LLM evaluation test generation by reading discovery manifests and tool definitions to create eval setup and scenario test files for your MCP tool collections.
LLM eval tests for MCP tools cover CRUD, read-only, search, and hierarchical workflows, ensuring robust and reliable AI agent behavior across different interaction patterns.
Yes, executing the generated LLM eval tests requires an LLM API key and a built project to validate your MCP tool collections against the designed scenarios.
Yes, automated test generation creates eval setup and scenario test files directly based on .discover.json files and existing tool definitions within your project structure.
Automated LLM evaluation test generation requires the project to be built beforehand and depends on an active LLM API key for execution, meaning it cannot run in isolated or unbuilt environments.
EotelManage eval-driven development workflows for software feature evaluations.
zenbuappsImplement read query patterns for AIBDD PHP test When steps.
CursorTouchGenerate and execute automated test cases for Windows-MCP tools.
1k-offValidate C# MCP server tool listing and invocation with unit and integration tests.