mcp-release-qa

Validates MCP servers before release through live protocol sessions and parity checks.

38.5k|4.9k|Updated Jun 11, 2025
One-click install
npx skills add https://github.com/github/awesome-copilot --skill mcp-release-qa
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: mcp-release-qa
Source: https://github.com/github/awesome-copilot/tree/main/skills/mcp-release-qa
Command: npx skills add https://github.com/github/awesome-copilot --skill mcp-release-qa

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Shipping an MCP server based only on unit tests or schema review leaves protocol behavior, transport correctness, and documentation drift unverified, causing broken releases for end users.

Core Features & Use Cases

  • Live Protocol Session Testing: Runs initialize, discovery, and invocation in one real session against a freshly built server process.
  • Inventory Parity Verification: Compares source registrations, runtime discovery output, generated catalogs, and documentation to detect drift.
  • Failure Path and Install Smoke Tests: Probes malformed requests, unknown methods, and invalid arguments, then verifies the documented install command in a clean environment.
  • Use Case: Before publishing a new version of an MCP server, run this skill to produce a reproducible PASS/FAIL evidence report covering session behavior, contract parity, and install verification.

Quick Start

Run a release QA check on my MCP server at the current commit and produce an evidence report with a PASS or FAIL verdict.

Frequently Asked Questions about mcp-release-qa

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I test an MCP server before release?

Build the candidate revision, start the documented entry point, and run one complete protocol session covering initialize, discovery methods, and representative invocations. Record exact commands, raw responses, and a PASS or FAIL verdict as reproducible evidence.

How to verify MCP server documentation matches runtime behavior?

Build four inventories from source registrations, live discovery output, generated catalogs, and documentation, then compare by stable identifier. Report entries missing at runtime, stale names or schemas, and install commands that fail to start the server.

What failure paths should an MCP server handle correctly?

Probe requests before initialization, malformed JSON-RPC envelopes, unknown methods, unsupported protocol versions, repeated initialization, and invalid arguments. Each response must carry the correct request ID, a useful error message, and no side effects or leaked stack traces.

Does MCP release testing work with STDIO and HTTP transports?

Yes, the process covers STDIO, Streamable HTTP, and SSE transports. For STDIO, stdout must carry only protocol messages with logs on stderr; for HTTP, record status codes, MCP headers, and session identifier handling.

Why is a single MCP session required instead of separate test processes?

A new process creates a new STDIO session, so one-shot requests test several incomplete sessions instead of one valid session. Keeping initialize, initialized notification, discovery, and invocation in one session proves real protocol compliance.