validate-against-reference

Compare a tool's outputs against reference fixtures with tolerance-aware diff reporting.

6|1|Updated May 17, 2026
One-click install
npx skills add https://github.com/AlexKapadia/Pixie --skill validate-against-reference
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: validate-against-reference
Source: https://github.com/AlexKapadia/Pixie/tree/main/.claude/skills/validate-against-reference
Command: npx skills add https://github.com/AlexKapadia/Pixie --skill validate-against-reference

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Runs Pixie's accuracy validator (check #12) against one tool's reference fixtures, reporting per-output diffs with tolerance-aware comparison to help verify reproducibility.

Core Features & Use Cases

  • Validate a single tool against its reference fixtures, surfacing per-output diffs with clear guidance.
  • Enforce strict tolerance handling to prevent false positives and to highlight meaningful differences.
  • Use for quick integrity checks during tool development or prior to releasing updates.

Quick Start

Run the reference-only validator for a single tool to generate a per-output diff report.

Frequently Asked Questions about validate-against-reference

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I validate tool outputs against reference fixtures to check reproducibility?

To validate tool outputs against reference fixtures, run this Skill to compare a single tool's outputs with its reference fixtures, surfacing per-output diffs using tolerance-aware comparison to verify reproducibility and accuracy.

What is tolerance-aware comparison when validating tool accuracy?

Tolerance-aware comparison enforces strict tolerance rules during reference fixture validation, preventing false positives by distinguishing meaningful output diffs from acceptable numerical variance. This ensures only significant accuracy deviations are reported.

How do I run a diff report for a single tool's reference fixtures?

Run the reference-only validator for a single tool to generate a per-output diff report. The Skill reads reference fixtures, runs the tool in a warm subprocess, and surfaces per-output diffs with exact tolerance rules for quick integrity checks.

Can I validate all tools in my project at once using reference fixtures?

No, this Skill validates a single tool against its reference fixtures, not all checks. It is designed for focused integrity checks during tool development or prior to releasing updates, reporting per-output diffs for one tool at a time.

When should I use reference fixture validation during tool development?

Use reference fixture validation during tool development or prior to releasing updates for quick integrity checks. It helps verify correctness and confirm reproducibility by surfacing per-output diffs with clear guidance before deployment.

Does the validator run tools in a warm subprocess for accuracy checks?

Yes, the validator runs the tool in a warm subprocess when checking accuracy against reference fixtures. This approach reads the reference fixtures and surfaces per-output diffs with exact tolerance rules to confirm reproducibility.