vanilla-agent-test-harness

Validate vanilla agent SOP discovery and dry-run execution via MCP+SOP protocol.

3|Updated Mar 29, 2026
One-click install
npx skills add https://github.com/SteveGJones/jack-tar-deckhand --skill vanilla-agent-test-harness
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: vanilla-agent-test-harness
Source: https://github.com/SteveGJones/jack-tar-deckhand/tree/main/.claude/skills/vanilla-agent-test-harness
Command: npx skills add https://github.com/SteveGJones/jack-tar-deckhand --skill vanilla-agent-test-harness

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Vanilla-Agent Test Harness automates end-to-end validation to ensure a zero-knowledge agent can locate SOPs on a company node and execute them via the MCP+SOP protocol, preventing production with unverified SOPs.

Core Features & Use Cases

  • Automated SOP discovery and schema validation using sop.discover against UniversalSOPSchema.
  • Safe dry-run execution of SOP operations with example parameters to verify parameter semantics, authority boundaries, and error handling.
  • Use cases include verifying MCP server implementations, SOP schema changes, and governance checkpoints to generate test artifacts and readiness evidence.

Quick Start

Instruct the vanilla agent to locate available SOPs on the target node and begin a vanilla-agent test pass.

Frequently Asked Questions about vanilla-agent-test-harness

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I validate a vanilla agent against MCP SOPs?

To validate a vanilla agent against MCP SOPs, you run an automated test harness that checks protocol-compliant behavior for SOP discovery, schema validation, and dry-run execution. It generates test artifacts and readiness evidence to prevent unverified SOPs in production.

What is MCP+SOP protocol testing for vanilla agents?

MCP+SOP protocol testing for vanilla agents is an end-to-end validation process ensuring zero-knowledge agents can locate and execute standard operating procedures on a company node. It specifies schema validation, operation discovery, and dry-run execution to verify parameter semantics and error handling.

How do I test SOP discovery and schema validation using the MCP protocol?

You test SOP discovery and schema validation by instructing the vanilla agent to locate available SOPs on the target node using sop.discover. The test harness validates these operations against the UniversalSOPSchema to ensure protocol compliance before production deployment.

Can I perform dry-run execution of SOP operations with test parameters?

Yes, you can perform dry-run execution of SOP operations using example parameters. This safe execution verifies parameter semantics, authority boundaries, and error handling without impacting production, generating test logs as readiness evidence.

Does the vanilla-agent test harness work across different MCP server implementations?

Yes, the vanilla-agent test harness applies validation across different MCP server implementations, SOP registrations, and readiness governance checkpoints to ensure consistent protocol-compliant behavior regardless of the underlying server setup.

What artifacts do I get from validating vanilla agents against SOPs?

Validating vanilla agents against SOPs generates test artifacts including sample parameters and test logs. These artifacts serve as readiness evidence for governance checkpoints and verify MCP server implementations and SOP schema changes.