hve-builder-tester

Test prompt-engineering artifacts with black-box scenarios, contained simulation, and independent grading.

1.4k|284|Updated Nov 2, 2025
One-click install
npx skills add https://github.com/microsoft/hve-core --skill hve-builder-tester
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: hve-builder-tester
Source: https://github.com/microsoft/hve-core/tree/main/.github/skills/hve-core/hve-builder-tester
Command: npx skills add https://github.com/microsoft/hve-core --skill hve-builder-tester

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

Prompts, instructions, agents, subagents, and skills are hard to verify: authors cannot tell whether an artifact actually behaves as intended at its target reasoning profile. This Skill exercises those artifacts through black-box scenarios, captures containment evidence, and produces an independently graded behavior report.

Core Features & Use Cases

  • Black-box behavior testing: Designs scenarios that exercise an artifact only through its documented interface, without leaking internal structure or test framing.
  • Fidelity control: Runs contained simulation via the HVE Artifact Tester by default, or approved native execution when read-only or sandbox containment preconditions are met.
  • Independent grading and durable reports: Dispatches a separate grading subagent and writes a durable report with verdict, findings by action category, fidelity limitations, and a human-review checkbox.
  • Correction-run reuse: Reuses prior passing evidence only when every equivalence dimension is traceable, re-executing affected scenarios.
  • Use Case: After authoring a new Copilot agent, invoke this Skill to simulate its behavior at the Medium profile, receive a Pass/Revise/Blocked verdict with severity-ordered findings, and apply corrections before release.

Quick Start

Ask the assistant to run the hve-builder-tester skill against your prompt or agent file at its intended profile and produce a behavior report.

Frequently Asked Questions about hve-builder-tester

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I test a GitHub Copilot agent or prompt before releasing it?

Invoke the hve-builder-tester skill with the artifact as the target. It designs black-box scenarios, executes them in a contained simulation sandbox, and returns an independently graded report with a Pass, Revise, or Blocked verdict.

What is the difference between simulation and native fidelity in behavior testing?

Simulation runs the HVE Artifact Tester, which follows the artifact literally inside a sandbox and supports conformance claims only. Native fidelity dispatches the registered agent or skill directly and is permitted only for read-only targets or enforced sandbox containment.

Can I reuse prior test evidence after fixing an artifact?

Yes, through a correction run, but only when every equivalence dimension holds: prior Complete execution with Pass verdict, unchanged purpose, profile, fidelity, and design, plus traceable revision impact mapping. Untraceable scenarios are treated as affected and re-executed.

Which reasoning profile should my artifact be tested at?

Test at the profile the finished artifact declares: High for deepest reasoning, Medium for semantic design and review, Low for literal mechanical behavior. Design and grading always run at the higher of Medium and the target profile.

What are the limitations of simulation-based behavior testing?

Simulation evidence supports conformance and instruction-clarity claims only; it cannot establish native tool-use reliability. A higher-tier simulator may also repair ambiguity a lower-tier run would expose, which the report must disclose.