validation

Validate pipeline outputs with checkpoint-level assertions and paired feature testing.

Updated Apr 20, 2026
One-click install
npx skills add https://github.com/thistleknot/skills --skill validation-thistleknot
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: validation
Source: https://github.com/thistleknot/skills/tree/main/validation
Command: npx skills add https://github.com/thistleknot/skills --skill validation-thistleknot

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Validation prevents broken implementations from slipping through by enforcing checkpoint-level assertions and layer-output review, not just end-state success.

Core Features & Use Cases

  • Contract-first success criteria: Treat a solution as correct only after it runs successfully and layer outputs are inspected.
  • Assert Strategy across checkpoints: Place assertions at data checkpoints within the pipeline, using feature-scoped variables, and verify presumed vs actual conditions.
  • Validation architecture pattern: Use a dedicated validation class (one function per feature) that evaluates returned processing outputs, with calls orchestrated from main.
  • Paired feature validation: Validate base and variant in the same run (e.g., dimensional/paired or gated feature testing), including gating logic, coexistence, and edge cases.
  • Iterative scale & reversibility: Progress validation from small to production-scale datasets and confirm forward/backward transformation reversibility.

Quick Start

Run the full pipeline for your change, capture each layer’s inputs and outputs, and only accept success when all checkpoint assertions and paired-feature checks pass.

Frequently Asked Questions about validation

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I verify pipeline outputs during agentic coding workflows?

Verify pipeline outputs by enforcing checkpoint-level assertions and inspecting layer outputs, not just checking end-state success. Contract-driven validation ensures broken implementations are caught early by confirming intermediate data transformations match expected conditions.

What is the best way to structure test assertions for data processing pipelines?

Structure test assertions using a dedicated validation class with one function per feature. Orchestrate calls from main and place assertions at data checkpoints using feature-scoped variables to verify presumed versus actual conditions throughout the pipeline.

How do I validate base and variant features in the same pipeline run?

Validate base and variant features together using paired feature testing to check gating logic, coexistence, and edge cases. Running both in the same test execution confirms extensibility works correctly without breaking existing pipeline functionality.

When do I need contract-driven testing for pipeline checkpoints?

Contract-driven testing for pipeline checkpoints is needed when preventing broken implementations from slipping through. It treats a solution as correct only after successful execution and inspection of layer outputs against explicit contracts at every data checkpoint.

How do I scale validation tests from small datasets to production scale?

Scale validation iteratively from small to production-scale datasets while confirming forward and backward transformation reversibility. This progressive approach captures artifacts at each checkpoint to ensure pipeline integrity holds as data volume increases.

Why does my pipeline pass end-state tests but still produce broken intermediate outputs?

Pipeline end-state tests miss broken intermediate outputs because they skip checkpoint-level assertions. Applying contract-driven validation with layer-output review at each data checkpoint catches transformation errors that end-state success criteria overlook.