field-test

Run end-to-end field tests of MCP tools against a live HTTP server.

148|28|Updated Mar 20, 2025

Search Tags:#testing #catalog #mcp #server #http #report #field-test

Ready to run

npx skills add https://github.com/cyanheads/mcp-ts-core --skill field-test

💬 Prompt for ChatGPT / Claude Chat▼

Please help me install this Agent Skill.
Skill: field-test
Source: https://github.com/cyanheads/mcp-ts-core/tree/main/skills/field-test
Command: npx skills add https://github.com/cyanheads/mcp-ts-core --skill field-test

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Field-test validates MCP tool definitions by running them against a real HTTP server, surfacing the catalog, executing inputs, and producing a focused report with concrete findings and clear follow-up options.

Core Features & Use Cases

Start a live MCP server, surface the available tools and resources, and run end-to-end tests against real transports.
Execute realistic and adversarial inputs to verify input handling, output formats, and error messages.
Generate a concise, actionable report with prioritized follow-ups for tooling and definitions.

Quick Start

Start the field-test workflow against your MCP server to generate a live evaluation report.

Frequently Asked Questions about field-test

High-intent search queries and answers about installing and using this skill.

FAQPage Schema

How do I test MCP tools against a live HTTP server?▼

Field-testing MCP tools requires a running HTTP server and the ability to monitor the process. It initializes a session, executes real and adversarial inputs against definitions, and produces a focused report with concrete findings and follow-up options.

What is the best way to validate MCP tool definitions end-to-end?▼

Validating MCP tool definitions end-to-end involves executing realistic and adversarial inputs against a live HTTP server. This verifies input handling, output formats, and error messages, yielding a concise report with prioritized follow-ups.

Do I need a running server to run MCP field tests?▼

Yes, a running server is required. You need the ability to start and monitor the MCP process, access the catalog, and reach the endpoints to exercise definitions and generate a report.

Can I use field testing to check MCP error messages and input handling?▼

Yes, field testing executes realistic and adversarial inputs to verify input handling, output formats, and error messages. It runs these tests against live transports and documents the results in a concise, structured report.

What does an MCP field test report include?▼

An MCP field test report includes concrete findings from executing real inputs against tool definitions, along with prioritized follow-up options. It provides an actionable evaluation of input handling, output formats, and errors.