field-test

Run end-to-end field tests of MCP tools against a live HTTP server.

148|28|Updated Mar 20, 2025
One-click install
npx skills add https://github.com/cyanheads/mcp-ts-core --skill field-test
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: field-test
Source: https://github.com/cyanheads/mcp-ts-core/tree/main/skills/field-test
Command: npx skills add https://github.com/cyanheads/mcp-ts-core --skill field-test

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Field-test validates MCP tool definitions by running them against a real HTTP server, surfacing the catalog, executing inputs, and producing a focused report with concrete findings and clear follow-up options.

Core Features & Use Cases

  • Start a live MCP server, surface the available tools and resources, and run end-to-end tests against real transports.
  • Execute realistic and adversarial inputs to verify input handling, output formats, and error messages.
  • Generate a concise, actionable report with prioritized follow-ups for tooling and definitions.

Quick Start

Start the field-test workflow against your MCP server to generate a live evaluation report.

Frequently Asked Questions about field-test

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I test MCP tools against a live HTTP server?

Field-testing MCP tools requires a running HTTP server and the ability to monitor the process. It initializes a session, executes real and adversarial inputs against definitions, and produces a focused report with concrete findings and follow-up options.

What is the best way to validate MCP tool definitions end-to-end?

Validating MCP tool definitions end-to-end involves executing realistic and adversarial inputs against a live HTTP server. This verifies input handling, output formats, and error messages, yielding a concise report with prioritized follow-ups.

Do I need a running server to run MCP field tests?

Yes, a running server is required. You need the ability to start and monitor the MCP process, access the catalog, and reach the endpoints to exercise definitions and generate a report.

Can I use field testing to check MCP error messages and input handling?

Yes, field testing executes realistic and adversarial inputs to verify input handling, output formats, and error messages. It runs these tests against live transports and documents the results in a concise, structured report.

What does an MCP field test report include?

An MCP field test report includes concrete findings from executing real inputs against tool definitions, along with prioritized follow-up options. It provides an actionable evaluation of input handling, output formats, and errors.